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ABSTRACT 

A project was conducted to develop a 
cost-effectiveness mqdel and data instruments to be utilized in the 
management of secondary vocational programs. Based upon reviewed 
literature^ cost effectiveness analysis was conceptualized as an 
analytical technique and eight key elements were identified. The 
model that was then developed includes four major components: 
Vocational program classif ications, program objectives and 
specifications^ program outputs, and costs. Based upon the four 
components r the model was designed to generate three kinds of 
cost-effectiveness measures: (1) Program ef fectiveness, (2) cost 
efficiency^ and (3) cost-effectiveness ratio and/or performance 
ratio. Five kinds of data instruments were produced: (1) School 
corporation information^ (2) secondary vocational instructional 
program data^ (3) student follow-up program rating scale, (U) 
employers* option on vocational training of employees, and (5) 
vocational instructional program cost data. In addition, a standard 
procedure for using the model and data instruments was conceptualized 
as three primary activities: Planning, implementing, and utilizing. A 
project advisory committee and national advisory panel for the 
project reviewed materials developed by the project staff making 
conclusions and recommendations. (Author/HD) 
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ABSTRACT 



Purpose , A cost-effectiveness model and data instruments to be 
utilized in the management of secondary vocational programs were developed 
in the project. This report covers a rationale for the model and descrip- 
tion of the model elements - 

Procedures , Based upon reviewed literature, cost-effectiveness 
analysis was conceptualized as an analytical technique. Eight key 
elements were identified. As a conceptual framework, a cost-effectiveness 
model was developed that generated three types of cost-effectiveness 
measures. The types of cost-effectiveness measures were tested using 
hypothetical data. Data collection instruments, standard procedure for 
using the model, and data instruments were developed. A Project Advisory 
Committee and National Advisory Panel for the project reviewed materials 
developed by the project staff. 

Products , This technical report synthesizes literature related to 
cost-effectiveness concepts and notes a theoretical basis for cost- 
effectiveness analysis of secondary vocational programs. The cost- • - 
effectiveness analysis model includes four major components: vocational 
program classifications, projgram objectives and specifications, program 
outputs, and costs. Based upon the four major components, the model was 
designed to generate three kinds of cost-effectiveness measures: (1) pro- 
gram effectiveness, (2) cost efficiency, and (3) cost-effectiveness 
ratio and/or performance ratio . 

Five kinds of data instruments wera produced: (1) school corporation 
information, (2) secondary vocational instructional program data, (3) student 
follow-up program rating scale, (4) employers' opinion on vocational 
training of employees, and (5) vocational instructional program cost data. 
In addition, a standard procedure for using the model and data instruments 
were conceptualized as three primary activities: planning, implementing, 
and utilizing. These phases are delineated in this report. 
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CHAPTER I 



Introduction 

This report presents a cost-effectiveness analysis model for 
secondary vocational programs as a technical repqrt from the Indiana 
Cost-Effectiveness Project. Ihe project was carried out at Indiana 
University — Bloomington with the financial support of the Indiana State 
Board of Vocational and Technical Education. The purpose of the pro- 
ject was to develop a cost-effectiveness analysis model and administrator 
manual for guiding locally conducted cost-effectiveness studies of 
secondary vocational programs. The man\ial was developed as a practical 
report separate from this t:e-hnical report. The statement of the objec- 
tives, procedures, and organizeition of thi? report follows. 

OBJECTIVES AND PROCEDUHES 

The objectives of this report were to (1) conceptualize a cogt- 
ef fectiveness zmalysis, (2) develop a cost-effectiveness analysis model 
and Instruments, and (3) evaluate the model and instruments for valida- 
tion in their use. To reach these objectives, the following procedures 
were utilized: 

First, based on a review of the related literature, a cost-effec- 
tiveness analysis was defined and eight elements were identified. The 
cost-effectiveness emalysis concept was distinguished from the concept 
of cost-benefit analysis but related to Planning, Programming, Budgeting 
System (PPBSi . Some research studies on cost analysis, cost-benefit 
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analysis, and cost-effectiveness. analysis of secondary vocational programs 
were reviewed along with needs for cost-effectiveness analysis of such 
programs • 

Second, based upon the reviewed literature, a conceptual model for 
cost-effectiveness analysis of secondary vocational programs was developed 
for use. The model consists of four major components j vocational program 
structure, objectives, costs, and outputs; three measures : effectiveness 
efficiency, and a C/E and performance ratio; and two additional factors: 
student and community characteristics • Data instruments and forms were 
also developed as was a standeird procedure for using this model. 

Third, an advisory committee for the project implementation, con- 
sisting of three local vocational directors, three ctate vocational 
officers, and one professor, rfjviewed and made comments on the development 
of the cost-effectiveness analysis model and instr\jments« The efforts 
of the committee were focused upon the development of program objectives 
and their specifications. The committee members validated a set of 
program objectives and specifications. They also advised the use of the 
state, recommended accounting system, which appeared in Handbook II (U.S. 
Office of Education, Financial Accounting, 1973), for analyzing costs of 
vocational programs. 

Fourth, in the process of the product's development, a national 
advisory panel was consulted for review and comments on the cost-effec- 
tiveness analysis model and technical procedures. Their reading and 
comments on an earlier draft of this report were reflected in finalizing 
the draft. However, the consulting advice and assistance did not reflect 
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individual or panel endorsement of the study and its products. 

Fifth/ quarterly reports on the progress of the project were pre- 
sented to the State research coordinator r the project monitor, and the 
third party evaluator. The project received favorable responses from 
the project monitor and the third party evaluator. 

Finally, to increase the usefulness of the model and instruments, 
a site visitation was conducted in three school corporations in the state 
of Indiana. Throughout the site visitation, the model and data collection 
instruments were examined by vocational directors and bvusiness managers 
in terms of data availability, ease of data collection, and formats of 
instruments. Original instruments were revised to simplify the collection 
of the required data on the major components of the cost-effectiveness 
model. Hypothetical data were used for testing cost-effectiveness mea- 
sures as developed in the model. 

ORGANIZATION OF REPORT 

This report is organized into four chapters. Following Chapter 
I, Chapter II reviews the theoritical basis for cost-effectiveness analy- 
sis, the need for such analysis, and research studies on cost-effective- 
ness analysis of secondary vocational prograims. 

Chapter III describes the conceptual model and specifications for 
cost-effectiveness analysis of secondary vocational programs. It also 
includes the development of data types, instruments and analytical forms, 
along with a standard procedure for vising the model. 

Chapter IV disciisses the evaluation of the cost-effectiveness 
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analysis model and instruments, along with examination of cost-effective- 
ness measures. The chapter makes conclusions and recommendations including 
suggestions for further studies which are followed by supporting documents 
such as references and appendices. 
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CHAPTER II 



Theoretical Sasis for Cost-Ef ectiveness 

This chapter presents joncepts of cost-effectiveness analysis and 
the need for vocational education program evaluation and planning^ and it 
reviews some research studies on cost-effectiveness analysis of vocational 
programs at the secondary school level, 

CONCEPTS OF COST-EFFECTIVENESS ANALYSIS 

An operational definition of cost-effectiveness analysis provides 
a groundwork for conceptualizing cost-effectiveness as an analytical 
technique. It is distinguished from the cost-benefit concept for this 
project. The role of cost-effectiveness analysis is related to PPBS, 
Planning./ Programming, and Budgeting Systems. 

Definition and Elenients 

Cost-effectiveness analysis is defined in different ways from 

different perspectives, guade (1967) defines cost-effectiveness analysis 
in a broad sense as an "analytical study designed to assist a decision- 
maker in identifying a preferred choice among possible alternatives," 
and, narrowly f it is a "comparison of alternative courses of action in 
terms of their costs and their effectiveness in attaining some specific 
objectives" (pp. 1-2). Under the definition, he indicates five elements 
of cuialysis: (1) the objectives, (2) the alternatives as the means by 
which it is hoped the Objectives can be attained, (3) the. costs, 
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(4) the model which, as a simplified representation of the real world, 

abstracts the features of the situation' relevant to the question being 
studied, and (5) a criterion as a rule or standard by which to rank the 
altfernatives in order of desirability and choose the most promising (pp. 
4--5). Benson (1968, p. 257) emphasizes systematic examination and com- 
parison of alternative courses of action for cost-effectiveness analysis 
on the basis of critical appraisal of both the assessment of (1) direct 
and indirect costs in the present and future and (2) gains and benefits 
that accrue to each of the different courses of action. 

In other words, the term cost-effectiveness analysis is expressed 
as a procedure by means of which the costs of alternative means of achiev- 
ing a stated objective, or, conversely , the effectiveness of alternative 
means for a given cost, are compared in a series of numerical indices 
(Seller, 1969). For an instructional cost-effectiveness analysis, the 
analysis is defined as "the process of solving problems of choice requir- 
ing the definition of measurable objectives, identification of alternative 
ways of achieving the objectives^ identification of the anticipated cost . 
and effectiveness for each alternative, and identification of the optimuiri 
alternative which potentially achieves the desired objectives for the 
educational activities of a school" (Gary, 1972, p. 61). 

Knezevich (1973) defines a cost-effectiveness analysis as a "system- 
atic examination of an alternative in terms of its advantage?, as measured 
by a fixed level and quality of an outcome, and disadvantages, as measured 
by the economic cost" (p. 326). He also operationalizes the nature of 
cost-effectiveness analysis into a series of activities; (1) specifica- 
tion of objectives, (2) identification of alternative means, (3) generation 
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of a model for the problem under study, (4) computation of costs (disad- 
vantages) for each alternative means to am objective, (5) determination 
of effectiveness (advantages) for each alternative, (6) computing the 
degree of relationship between cost and effectiveness for alternatives / 
(7) agreeing on a criterion, that is, a rule or standard, to be used for 
ranking and selecting alternative means to an objective, amd (8) recog- 
nizing the importance of iterative processes for confirming refinement of 
the analysis (p. 185) . 

Thus, the concept of cost-effectiveness analysis is defined in 
different ways, and most definitions infer a simulation of cost-effective- 
ness of alternative programs or courses of action to accomplish predeter- 
mined objectives. However, the use of cost-effectiveness analysis is 
available not only for con^jarison of alternative programs, but also for 
assessment of the effectiveness of operating programs as compared with 
associated costs. From this point of view, an operational definition 
of cost-effectiveness analysis is : an analytical tool for aissessing out- 
puts o± operating or alternative programs in achieving specified program 
objectives, as related to the costs. Furthermore, the following elements 
are identified: 

1. The Program or Alternatives . The first element is to define 
the operating or alternative program for achieving certain 
goals or objectives. 

2. Program C^jective (s) . Program objectives are specified by 
certain target goals that the program should reach. 

3. The Costs . Costs are amounts expended for the purpose of 
achieving program objectives. 

4. Tne Output , Outputs aure the products or expected results 
from the program. They are often numerically expressed indi- 
eating the actual attainment of program objectives. 
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5. A Model. A model is a simplified representation of the rela- 
tionships among the elements mentioned above. The purpose of 
the model is to produce critical measures to be used in the 
decision-making process. 

6- The Effectiveness , Effectiveness is a measure of the' extent 
to which the objective is achieved. 

"7- The Efficiency , Efficiency is a measure of the relationship 
between the output and the cost. 

8- A Ratio , An index ratio or criterion by means of which the 
desirability of a program is indicated on the basis of the 
degree of program effectiveness over costs. 

Accordingly, the development of a cost-effectiveness analysis model 
for secondary vocational programs was directed toward (1) defining voca- 
tional programs, (2) specifying program objectives, (3) assessing outputs 
as associated with objectives, and (4) estimating program costs. The 
model will produce three measures of effectiveness, efficiency, and a ratio. 

Cost-Effectiveness and Cost-Benefit Analysis 

The definition of cost-effectiveness analysis is distinguished 
from cost^benefit analysis. Both of these concepts are used for assess- 
ing outputs over the common denominator of costs* However, there are dif- 
ferences in techniques for measuring effectiveness and benefit for each 
analysis. Whereas effectiveness is measured by the achievement degree of 
progr&m objectives, benefit is measured in a monetary unit. 

As an economic analysis for assessing alternative programs, cost- 
benefit analysis is directed toward a comr,arison of the costs and the 
resulting monetary benefits of one or more programs. It attempts to gen- 
erate three criteria: (1) the net expected present value, (2) the benefit- 
cost ratio, and (3) the expected internal rate of return (Stromsdorfer , 
1972, p. 12). Thus, in a cost-benefit analysis^ both inputs and outputs 
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are expressed in monetary terms (Alkin, 1970, p. 222; Rossmiller & Geske, 
1976/ p. 489). For instance / a cost-benefit analysis of a vocational 
education program attempts to identify all monetary benefits resulting 
from the program. As a criterion for evaluating the program, it provides 
a ratio of the total value of benjp^fits (in dollars) over the total costs, 
or a rate of return to investment in the vocational education program. 

Unlike cost-benefit analysis, cost-effectiveness analysis concen- 
trates on the measure of specified goal attainments of the program against 
the associated costs. "When the effectiveness of programs in achieving 
a particular goal [rather than their monetary values] is linked to costs," 
Levin (1975) contends, "the approach is considered to be a cost-effec- 
tiveness rather than a cost-benefit analysis" ipp. 92-3) . Since the 
effectiveness is not the same as the unit of costs, this analysis gener- 
ates a ratio that reveals some degree of effectiveness as compared with 
cost or efficiency of the program. The ratio assists in making decisions 
either to minimize dollar costs subject to some degree of effectiveness, 
or to miBocimize the measure of effectiveness with a budget constraint. 

Cost-effectiveness analysis and cost-benefit analysis are popular 
terms for components of systems analysis. They provide a criterion or 
ratio for evaluating operating and/or alternative programs in terms of 
the total value of gains over the total costs. In educational contexts, 
however, some benefits are easily identified, but not all the educational 
outcomes are measured by monetary benefits. It is also quite difficult 
to define the scope of a cost-benefit study when to conduct such a study 
may require information spanning a lifetime after schooling. The effec- 
tiveness measure is more easily identified and obtainable than measurement 
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of benefits, because the scope can be determined by the selected objec- 
tives of the program which is to be analyzed. Therefore, cost-effective- 
ness is considered more applicable to evaluate educational programs 
(Knezevich, 1973, pp. 184-5; Forbes, 1974, p. 21). 

Cost-Effectiveness and PPBS 

Cost-effectiveness analysis is of significance in a systems analy- 
sis approach such as Planning Programming Budgeting System (PPBS) . Some- 
times it is perceived to be the systems analysis process itself, including 
apt only a comparison of alternative programs, but also the specification 
of sensible objectives, the determination of a satisfactory way to measure 
performance, and the influence of considerations that can not be quanti- 
fied (Quade, 1966/ and 1967). Others see cost-effectiveness analysis as 
being related to and a subset of the total systems design process. For 
example, Heaton [1969, p. 35) identifies cost-effectiveness analysis with 
alternative trade-off studies, one of four phases of systems analysis 
which follows the first two phases of goal definition and alternative develop- 
ment, and which precedes the final phase of alternative selection. Both 
viewpoints of the role of cost-eiff ectiveness analysis could be appropriate, 
depending on the time and conditions that the analysis requires. 

As an analytical technique, cost-effectivenesis analysis is of 
significance in the PPBS context. In essence, PPBS, or as it is sometimes 
called, program budgeting, was originally developed as an analytical means 
of planning federal programs. Under the PPB system, each department was 
requested, by President Johnson, to develop its objectives and goalp; to 
evaluate each of its programs to mecc these objectives, weighing the bene- 
fits against the costs; to examine alternative means of achieving these 
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objectives; to shape its budget request on the basis of this analysis, and 
to justify that request in the context of a long-range program and finan- 
cial plan (Lyden & Miller, 1968, p- 5) , 

According to Hataiy and Cotton (1967) , systematic analysis of alter- 
natives is the crux of PPBS, It includes: (1) iri'.entifi cation of the 
governmental objectives; (2) explicit systematic identification of alter- 
native ways of carrying out the objectives; (3) estimation of the total 
cost implications of each alternative; (4) estimation of the expected 
results of each alternative, and (5) presentation of resulting major costs 
and benefit trade-offs among the alternatives (p, 15), From the future 
perspective, cost-effectiveness analysis is integrated into a PPB system 
as shown in the following statements (Mushkin, 1967, p, 1) : 

1, Clarifying and specifying the ultimate goals or objectives 
of each activity for which a government budgets money. 

2. Gathering like activities into comprehensive categories or 
programs designed to achieve the specified objectives, 

3. Examining as a continuous process how well each activity or 
program has don6j its effectiveness , 

4. Analyzing proposed inprovements or new program proposals to 
see how effective they may be in achieving program goals, 

5, Projecting the entire costs of each proposal not only for 
the first year, but for several subsequent years, 

6, Formulating a plan, based in part on the ainalysis of pro- 
posed cost and effectiveness, that leads to implementation 
through the budget. 

Furthermore, Knezevich (1973, p. 4) developed the PPBADERS cycle 
of activities? (1) jPlanning for clarifying goals; (2) Programming for 
generating alternative approaches to goals; (3) Budgeting for translating 
progroJns into fiscal requirements; (4) Analyzing for determining cost- 
effectiveness of alternatives; (5) Deciding the optimum course of action; 
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(6) Evaluating outcomes and relating each to prior expectations, and (7) 
Recycling for feeding evaluative judgements into the system to begin a 
modified PPBADER cycle. The cycle concept shows not only the relation- 
ship of cost-effectiveness analysis with ppb systems, but also its role 
in evaluating and planning educational programs. 

Thus, cost-effectiveness analysis is a prerequisite w:,thin a PPB 
system. The potential of PPBS would be determined by the depth of the 
analysis for identifying full cost implications and gains of program 
alternatives. Also the analysis can be undertaken with the emphasis on 
educational program evaluation and planning, whether or not such analysis 
is part of an integrated ppB system. The results of cost-effectiveness 
analysis of educational programs <:ould provide for cost implications, 
effectiveness of program alternatives in attaining objectives, and infor- 
mation that is brought together to give greater precision to the decision- 
making process, 

NEEDS FOR COST-EFFECTIVENESS ANALYSIS 

A cost-effectiveness analysis can be \ised for guiding vocational 
administrators' decisions concerning the allocation and utilization of 
resources, and the ev nation and planning of vocational education pro- 
grams. Furthermore, the increasing demand and support for vocational 
education programs require systematic analyses of the gains and costs 
of the programs. As analytical techniques, cost-effectiveness analyses 
should be helpful in providing rationales for supporting vocational 
educatxon. 
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Resource Allocation and Utilization 

Cost-effectiveness analyses can be directed toward optimization 
of resource allocation and utilization to increase econoinic efficiency 
of vocational education programs - 

During the past decade there has been growing interest in the eco- 
nomic aspects of education. Thrse reasons for the growing interest are 
cited by O'Donoghue (1971, p. 1): (1) the increase in the volijone of 
educational activity which makes education one of the largest industries 
and one of the chief employers of highly skilled personnel, (2) the 
recognition that education may have a significant influence on the employ- 
ment and income opportunities open to people and may affect the distribu- 
tion of income and wealth in society, and (3) the post war emphasis on 
economic growth and development. 

An economic viewpoint of education concerns the efficiency which 
the resources allocated to education are utilized (Blaug, 1970) . The 
general question of efficiency in pxiblic expenditures is one which recently 
has received considerable attention from economists. It is, however, 
important to recognize that economic efficiency meains not conducting 
education on a "least-cost" basis, but "the achievement of a given objec- 
tive with the least cost or the maximization of a given objective with a 
given cost" (Kaufman, 1968, p. 6) . 

The growing interest and recognition of education in economic 
growth generated efforts toward mciximizing the gains from scarce resources. 
One of these efforts is cost-effectiveness analysis. Seller (1969) re- 
lated cost-effectiveness analysis to classic economic theory when he as- 
S'^med, "the similarity between the two is apparent when one considers a 
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well-accepted definition of economics as being concerned with the alloca- 
tion of scarce resources, among competing ends to maximize satisfaction" 
(p. 2). According to Levin (1975), the focus of cost-effectiveness analy- 
sis is to explore "a strategy or a combination of strategies that maximize 
the results for any particular resource or budget constraint" (p. 89). 

As a. decision model for an optimal allocation or .utilization of 
resources, cost-effectiveness analysis may be used to provide decision- 
makers with a useful criterion in allocating or utilizing a given set of 
resources among numerous competing needs in rational and optimal ways. 
A cost-effectiveness analysis of vocational education programs can be made 
for the purpose of comparing them with general and academic programs or 
to identify the most desired program among competitive vocational programs. 
A- a result, the analysis coul.?, .increase economic efficiency by allocating 
a given amcint of resources to the most worthy of vocational education 
programs . 

Vocational Program Evaluation and Planning 

Cost-effectiveness analysis is needed for the evaluation, develop- 
ment, and planning of vocational education programs. Kaufman (1968) 
views cost-effectiveness analysis as a method for the evaluation of voca- 
tional education. He contends that "evaluation requires (i) the analysis 
of measured quantities in terms of the attainment of objectives and pro- 
gress toward goals, (2) an estimate of the value of existing programs in 
determining this progress, and (3) an estimate of the costs involved in 
the conducting of these programs" (p. lo) . The purpose of evaluation is 
to provide "useful information for judging decision alternatives" (Stuffle- 
beam, et. al. , 1971, XXV). As an evaluating technique, cost-effectiveness 
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analysis is expected to provide the decision maker with information re- 
lated to the "cost of achieving progrcon objectives; overall effectiveness 
of a program in achieving its objectives; and prograr effectiveness with 
subgrcups of students" (Forbes, 1974, p. 21). rhis information is of* 
value in deteinoaining if existing vocational programs should be expanded, 
continued/ modified, or deleted. 

In addition to program evaluation at the operations level, cost- 
effectiveness analysis may be used for developing new programs. Cost- 
effectiveness evaluation of a newly developed instructional product or 
set of materials may be used to compare a proposed program with the con- 
ventional mode of education or to compare two new instructional products 
(Wentling and Lawson, 1975, p. 310). On the other hand, alternative 
programs for achieving a certain objective can be evaluated in terms of 
their costs related to their payoffs. In this case, the existing conven- 
tional program should be replaced by the most effective alternative pro- 
gram. 

Furthermore, cost-effectiveness analysis provides useful informa- 
tion for program planning. Schwarz (1968) discusses cost-effectiveness 
analysis in long-range planning, which consists of: (1) the setting of 
objectives, (2) forecasts of future environment, (3) determi.nation of 
different alternatives, and (4) determination of a preferred course of 
action considering the objectives, the possibilities/ and the constraints 
(p. 32), He also assumes that the chare.cter of cost-effectiveness analy- 
sis in educational planning varies betwaen different -types of decision 
problems or different decision levels (p, 38) . 

Carpenter and Haggart (1970) view cost-effectiveness analysis as 
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a tool that can assist the planner in relating the resources required by 
an educational program to its effectiveness. For planning purposes, they 
contend that analysis may be used to: (1) help assess the relative worth 
cf several innovative programs with the same educational outcome, (2) 
determine whether a simple program is becoming more or less effective as 
time passes, or (3) help assess the relative worth of the same program 
for different school settings (pp. 1-2). 

It is an essential part of program planning to relate resources 
to outputs. Consequently, cost-effectiveness analysis can be used for 
vocational program planning in order to maximize the effectiveness with 
a given amount of resources for the program or, alternatively, to produce 
the same level of effectiveness at the lowest possible cost. 

Demand ?nd Support for Vocational Education 

The demand and support for vocational education have been well 
reflecte:! in federal legislation, beginning with the Smith-Hughes Act 
(1917). The act provided for seven million dollars for the promotion 
of vocational agriculture, trades and industry, and home economics educa- 
tion. The George Barden Act of 1946 brought about a further expansion 
of the program. It authorized the expenditure of some 29 million dollars 
beyond the perpetual seven million dollars of the Smith-Hughes Act. In 
1956 the act was amended to add practical nursing and fishing occupations 
to the list of approved areas of instructicn. The National Defense Edu- ^ 
cation Act of 1958 contained a provision for both secondary and post- 
secondary enphasis on technical training by means of the development of 
area vocational schools. 

Vocational education took on a much broader prospectus after the 
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Vocational Education Act of 1963. The new funds were to be expended for 
state and local vocational education programs ur.der six broad categories 
designed to fit individuals for gainful employment, including business 
and office occupations not covered by the previous laws. Basically, the 
restrictiveness of the older acts was reduced, thus making them more 
appropriate to current needs. As a result, several categories were broad- 
ened, without the categorical limitations of the older legislation. The 
new act contained significant features to keep vocational education abreast 
of changes in the labor market by bringing vocational preparation to many 
groups not served by the present program. The act authorized 60 million 
dollars for fiscal 1964, 118.5 million dollars for fiscal 1965, 177.5 
million dollars for fiscal 1966, and 225 million dollars for all follow- 
ing years. 

The Vocational Education Act of 1963 was amended to help the "hard- 
to-reach'^ and the "hard-to-teach, " with" additional funding and program 
flexibility at the discretion of state and local school agencies. Pri- 
marily as an extension of the 1963 act, the 1968 amendment stressed the 
in?>ortance of meeting the needs of individuals through annual and long- 
term state planning, curriculum revision, exemplary programs, continuous 
evaluation, etc. and created a national advisory committee. It authorized 
542 million dollars, 858 million dollars, 870 million dollars, 910 million 
dollars, and 565 million dollars for the fiscal years 1969, 1970, 1971, 
1972, and 1973, respectively. Thus the demand for vocational education 
expanded its programs and increased federal support through legislation. 

This trend clearly appeared at the state level. Increasing enroll- 
ments required more funds to support vocational education proc^rams. In 
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the case of the state of Indiana, the total vocational education enroll- 
ment increased from 82 thousand in 1967 to 175 thousand in 1975, with an 
increase of 114 percent (Annual Report, 1975, p. 1). The secondary voca- 
tional enrollment as compared to the total secondary enrollments also 
increased 17 percent to 31.3 percent during the same period (p. 5). Fed- 
eral vocational education expenditures in Indiana increased to 14 million 
dollars in 1975 from 6-8 million dollars in 1967 (p. 6). Approximately 
half of the total amount was expended for secondary vocational programs. 
The state demand and support for vocational education will continue to 
be expanded. The Indiana State Plan for Vocational Education (1976) pro- 
jects vocational enrollments at the secondary level to bo 112 thousand by 
the 1976 fiscal year and 128 thousand by fiscal year 1980. A total 
amount of 48 million dollars will be needed for secondary vocational 
education programs in fiscal year 1980. 

As the demand and support for the vocational education programs 
increases, so does the need for evaluating vocational programs. The 
1963 Vocational Education Act and 1968 Amendments required the establish- 
ment of national and state advisory councils. One of the main tasks 
assigned to the council was to evaluate vocational programs and to develop 
short and long-range vocational education plans. Cost-effectiveness 
analysis approaches could be helpful to identify useful criteria for 
these evaluation and planning purposes. Even local vocational administra- 
tors may need locally conducted cost-effectiveness analyses and receive 
public and community support for their vocational programs by providing 
publics with useful information gained from the analyses. 
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COST-EFFECTIVENESS ANALYSIS OF VOCATIONAL PROGRAMS 

Diiring the past decade research reports on cost analyses, cost- 
benefit, and cost-effectiveness analyses of secondary vocational programs 
appeared under contracts with the U.S. Department of Health, Education, 
and Welfare. Some dissertation studies attempted to develop instructional 
cost-effectiveness analysis models for decision-making. 

Cost Analysis 

Dueker and Altman (1967) attempted to identify the kinds of cost 
and related data that can be obtained to aid planning and evaluating voca- 
tional education. Based on data collected from sixteen comprehensive 
and sixteen vocational schools, they analyzed costs in relation to 
school performance, operational-situational factors, and unemployment 
rate, in particular, according to the data reported by five vocational 
schools and four comprehensive schools, the general cost of education in 
comprehensive schools was lower than in vocational schools for 1961-62/ 
but rose much more rapidly to approximate the cost in vocational schools 
by 1965-66. 

An analysis of vocational program costs at the secondary and post- 
secondary levels was made to assist state and local administrators in 
obtaining financial support (Aldrich, III, 1972). Developmental efforts 
were given to (1) budget chart of accounts (direct instruction, indirect 
instructional costs, and non- instructional service grouping); (2) prora- 
tion of indirect costs; (3) base unit of measurement, and (4) cost esti- 
mation formula. The analysis of data from three high school districts 
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and one coiranunity college district from each of six states revealed that: 
(1) appropriate proration of indirect costs for general support and plant 
operation and maintenance is critical in determining precise total cost 
of an instructional service, (2) high school districts place less emphasis 
on instructional equipment replacement than do community college districts, 
(3) categorical support of vocational programs should be continued, (4) 
strong consideration should be given to additional financing for indus- 
trial arts services, and (5) more efficient program weighting factors are 
needed because they are neither sufficiently sensitive to local needs nor 
precise enough to be used in a state vocational fund's allocation system. 

Harris and C Fallon (1973) analyzed delivery costs per student con- 
tact hour for secondary vocational-technical education in Tennessee. Data 
were collected from a sample of six. selected schools teaching 58 courses 
in 109 separate classes and analyzed to determine direct and indirect 
costs per student contact hour for each course with and without consider- 
ation of site value, total cost per student contact hour per course, total 
cost of educating a student in each course, and projections of course and 
program costs for a five ^ear period. The results indicated no evidence 
that size of school or geographical location was important in determining 
the cost level, but teachers' salaries were found to be the largest direct 
cost. 

Cost-Benefit Studies 

From the economic perspective of vocational programs, cost-benefit 
studies are attempted to determine (1) average and/or marginal costs and 
benefits, and (2) both internal rates of return and net present values of 
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vocational programs. Stromsdorfer (1972) reviewed seven cost-benefit 
studies of secondary vocational-technical education, which have been done 
by (1) Eninger (1965); (2) Kaufman and Lewis (1968); (3) Corazzini (1968); 
(4) Taussig (1968); (5) Hu, et al (1969), and (6) Fernbach and Somers 
(1970). The studies revealed different magnitudes in the results. In 
comparison with conprehensive or academic programs, for example, average 
benefits ranged from 312 dollars to 667 dollars for vocational programs 
and rate of return to vocational programs ranged from 4.1 percent at low- 
est to 34.5 percent at highest (pp. 50-51). These different magnitudes 
appeared by program special area and resulted from different methodologies 
used in the studies. Through the review, it is suggested that "secondary 
vocational- technical graduates as a group do better (earn more) than 
academic or comprehensive high school graduates . . but not all occupa- 
tional specialties in vocational-technical education pay off equally well" 
(p. 69). 

Cost-Effectiveness Studies 

Cost-effectiveness studies are more complicated than cost-benefit 

studies by adding non-monetary and non-economic effects to monetary 
benefits. Hu, et al_ (1969) analyzed non-economic benefits such as voting 
behavior, career satisfaction, and economic aspiration of academic and 
vocational high school graduates, in addition to the analysis of economic 
benefits. Wbile they found significant differences in economic benefits 
between vocational- technical and other curricula, no statistical evidence 
was found for differential levels of non-monetary benefits. As a result, 
they assumed that "the economic benefits as measured may represent a fairly 
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close estimate of total monetary and non-6conoinic benefit" (p. 236) . a 
cost-effectiveness analysis of the vocational education program in Puerto 
Rico (1971) concentrated on measures of benefit-cost ratio by programs, 
and by selected occupations, districts, and schools, with minor consider- 
ation of non-monetary benefits such as lowering the crime rate and reduc- 
ing government expenditures for law enforcement, housing, and welx5<re. 

Molnar (1973) attempted to assess costs and effectiveness of se- 
lected cooperative vocational education programs as compared with non- 
cooperative vocational programs. Data from 12 school districts selected 
from three states (Minnesota, North Carolina, and Ohio) for the 1969-70 
and 1970-71 school years were used to explore the feasibility of conducting 
such a cost-effectiveness analysis. His effort was focused upon the com- 
parison of cost per student or cost per student hour for the program area, 
and effectiveness as measured by follow-up information, but no attempt 
was made to determine the relationship between cost and effectiveness 
measures. Even though there were no obvious differences in the costs 
or in the graduates' performances between the two programs, cost-effective- 
ness analyses were proved to be useful for policy formulation concerning 
vocational education methodologies. 

Some dissertation studies attempted to develop procedural models 
for instructional cost-effectiveness analysis. For a cost-effectiveness 
evaluation of occupational education, Burgett (1970) developed a procedural 
model which consists of six steps: (1) objectives, (2) behaviors, (3) 
measurt-ment, (4) collection, (5) analysis, and (6) appraisals (pp. 34-52). 
As a methoclological guide to the cost-effectiveness evaluation of instruc- 
tional programs (K-12) at the school center level, a conceptual design 
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was developed by Lovell (1971). The design includes various input models, 
a process model, and several output (effectiveness) models. Using the 
basic components of an administrative system as the conceptual framework, 
Gary (1972) developed an operational cost-effectiveness model for instruc- 
tional activities. The model is in the form of a systems manual that em- 
ploys narrative and graphic modes to describe the decision-making system 
related to instructional cost-effectiveness analysis. The manual includes 
(1) policy statements that provide guidelines for operating the decision- 
making system, (2) an illustrative organizational chart, (3) a flow chart 
indicating the sequence and relationship of activities, (4) flowscript 
procedures, (5) job outlines for unique personnel procedures, and (6) 
supplementary narrative and appendix materials (pp. 69-70). 

As reviewed above, more research efforts were given to cost analysis 
or cost-benefit analysis, rather than cost-effectiveness analysis of secon- 
dary vocational programs. Little consideration was paid to the measure 
of program effectiveness and its relationship to the program cost. No 
attempt appeared to develop a conceptual framework or model, explaining 
the relationship between effectiveness measures and costs of vocational 
programs. Some dissertation studies attempted to develop instructional 
cost-effectiveness evaluation models, but their efforts were limited to 
the conceptualization of analytical procedures or operation of cost-effec- 
tiveness evaluation of instructional activities. To increase the efficacy 
of a cost-effectiveness technique, it may require a deliberate effort to 
develop a technically useful model for explaining the cost and effecti-^e- 
ness relationship on the basis of the clear-cut concept of cost-effective- 
ness analysis in evaluating and planning vocational programs. 
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SUMMARY 

Cost-effectiveness analysis is defined as an analytical tool for 
assessing outcomes of operating and/or alternative programs in achieving 
specified objectives as related. to costs. The review of related liter- 
ature identified eight elements for cost-effectiveness analysis.- (i) the 
prograin(s); (2; the program objective (s) ; (3) the cost; (4) the output; 
(5) a model; (6^ effectiveness; (7) efficiency, and (8) a ratio. By 
concentrating on the measure of goal attainments of vocational programs 
against the co.ts, cost-effectiveness analysis is operationally distin- 
guished from cost-benefit analysis, but related to PPBS. As an analytical 
technique, cost-effectiveness analysis could increase the potential of 
the PPB system by providing decision-makers with cost implications and 
program effectiveness in achieving the stated objectives. 

Cost-effectiveness analyses of vocational programs can be used as 
a means to secure optimization of resource allocation and utilization. 
AS a method for program evaluation, cost-effectiveness analysis may be 
used in developing new programs as well as in evaluating existing voca- 
tional programs. For program planning purposes, the analysis is needed 
to maximize the effectiveness' with which a given amount of resources is 
utilized or to produce the same level of effectiveness at the lowest pos- 
sible cost. Furthermore, as the demand and support for vocational programs 
increases, so does the need for cost-effectiveness analyses of the programs 
to secure public support by providing useful information gained from the 
analyses. 

During the past decade, research studies on cost-effectiveness 
analyses of secondary vocational programs appeared under contracts with 
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the U.S. Office of Education. Most efforts were, however, given to cost 
analysis or cost-benefit studies, rather than cost-effectiveness studies. 
Some dissertations attempted to develop cost-effectiveness evaluation 
models, but their efforts were limited to the conceptualization of analy- 
tical procedure for cost-effectiveness evaluation of instructional acti- 
vities • 
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CHAPTER III 



A Cost-Effectiveness Analysis Model 

A conceptual model was developed for use in analyzing cost-effec- 
tiveness of secondary vocational programs. Also, a standard procedure 
for using the model wa3 developed along with data requirements and in- 
strvimehts needed for the model. 

COST-EFFECTIVENESS MODEL AND SPECIFICATIONS 

After reviewing three previously developed cost-effectiveness 
models, a conceptual model was developed for the project. A deliberate 
effort was then made to specify each component and measure involved in 
the model. 

Co&t-Effectlveness Models 

As mentioned earlier, no attempt has been made to develop a con- 
ceptual model for the analysis of cost-ef f ectivene^ss relationships except 
the sophisticated works done by Abt (1969) and Alkin (1970). They illus- 
trate an overall model and specific components and their relationships 
within the input-output framework. 

Abt and his associates (1969) developed an education system cost- 
effectiveness model designed to evaluate the relative school, student, 
and community effects and associated costs of alternative 1965 Title I 
programs for the disadvantaged. Since such programs are directed toward 
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increasing learning^ the model focuses on the changes in student achieve- 
ment and the attitudes and environmental factors influencing achievement 
in the target population (p. 65) . The overall model consists of five 
submodels: (1) school, (2) instructional process, (3) commuiity inter- 
actions, (4) costs, and (5) cost-effectiveness. Title I programs, user 
judgements, and school and comm'.aiity data base are considered as inputs. 
The outputs include (1) earning potential and equality of educational 
opportunity for commv.i^t\-', (2) graduates and dropouts within school, 
achievements and attitudes of student, and (3) specific efficiency measures 
such as affects per cost and effects per resource. The measure of the out- 
puts is to be made on a before-and-af ter-the-project basis (See Figure 1) . 

Alkin (1970) proposed a model for evaluating cost-effectiveness 
of instructional programs with prime consideration given to financial 
variables in education, specifically where a single school or school dis- 
trict is the unit of analysis.. The model includes five components of (1) 
student inputs referring to the nature and characteristics of the students 
entering the program, (2) financial inputs as the financial resources 
made available for carrying on the program, (3) manipulative character- 
istics of the way in which financial inputs are utilized within the pro- 
greun in combination with the student inputs, (4) outputs, referring to 
both the cognitive and non- cognitive changes and the impact of the program 
upon systems external to it, and (5) external systems, including the social, 
political, legal, economic, and other systems outside the school (See 
Figure 2) . 

Assuming that his mcdel is static and both the external system 
and the student inputs are non-manipulatable, Alkin concerned himself 
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Figure 2 



Alkin's Cost-Effectiveness Model 



From: Marvin C.^Alkin, "Evaluating the Cost-Effectiveness of Instructional 
Programs, in M. C. Wittrock & David E. Wiley, ed. , THE EVALUATION 
OF INSTRUCTION: ISSUES AND PROBLEMS (New YoL: H^lt, RineJart^d 
Wxnston, Inc., 1970), p. 226. 
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with the manipulatable variables within the system, that can be managed 
to maximize student outputs. Finally he illustrated three examples of 
the application of the model: (1) evaluating the cost^effectiveness of 
alternative instructional programs in terms of the financial resource and 
student outcome relationship; (2) evaluating the cost-effectiveness of 
individual school programs in the light of outcomes relating tc external 
systems, financial and student inputs, and (3) evaluating cost-effective- 
ness of input utilization options relating manipulatable characteristics 
with outcomes. Thus, Alkin's model specifies the input-outcomes rela- 
tionships among. the five components. 

Aside from these two models, a conceptual framework for economic 
analysis of education is being developed at the Wisconsin R&D Center 
for Cognitive Learning. The framework includes (1) resource inputs to 
the educational system from the external environment; (2) components of 
the educational system, consisting of system inputs and resource input 
mix(es); (3) the system outputs — monetary and non-monetary, and (4) 
feedback as the self-correcting mechanism for the system (Rossmiller & 
Geake, 1976). Based on the systems analysis scheme, the framework indi- 
cates the relationships among the educational system's parts and between 
the system and its environment. 

These models would be useful for research studies on the input and 
output relationships among the components of the educational system, but 
they are far from being practical in analyzing the cost-effectiveness 
relationship of education programs. These models also lack the specifi- 
cation of the "objective" dimension and "effectiveness" as a measure of 
the relationship between the objective and the associated output. The 
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essence of the cost-effectiveness analysis method is, according to Quade 
(1967) , to construct and operate within a model which introduces "a pre- 
cise structure and terminology that serves primarily as a means of com- 
munication, enabling the participants in the study to make their judgements 
in a concrete context" (p. 4) . 

As early as 1959, Kershaw and McKean proposed the use of systems 
analysis in education to assess the possibilities of making quantitative 
comparisons of educational systems. Before the comparisons could be made, 
they stressed the need for the development of the models and/or relation- 
ships required to estimate all costs, alternative processes and output 
measures (p. 1). Also, Knezevich (1973) emphasized that cost-effective- 
ness analysis should include a continuous cycle of activities based on 
defining objectives, designing alternatives to achieve objectives, evaluat- 
ing alternatives on a systematic basis, and using. models of units under study 
and quantitative analysis techniques (p. 330) . To make it possible to 
assess cost-effectiveness measures, research effort was given to developing 
a cost-effectiveness analysis model for secondary vocational programs. 

A Cost-Effectlvenoss Model for Secondary Vocational Programs 

In analyzing cost-effectiveness of secondary vocational programs, 
a conceptual model was developed by a simplified representation of the 
relationships among the major components: (1) vocational programs, (2) 
program objectives, (3) costs, and (4) outputs. The primary effort was 
focused upon generating three measures indicating (1) program effective- 
ness, (2) efficiency, and (3) a cost-effectiveness and performance ratio. 
The proposed model involves both student characteristics and community 
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demand and support as inputs to the school system. Economic and non- 
economic benefits for the community are implied by the long-term results 
of the school system. 

While an overall framework showing four major components, three 
cost-effectiveness measures, student and community inputs and long- 
term outputs of the school system is illustrated in Figure 3, three 
kinds of cost-effectiveness measures are conceptualized in relationship 
to the four conponents as shown in Figure 4. Effectiveness is measured 
by the relationship between planned program objective/goals and actual 
outputs, efficiency is measured by the unit cost concept and indexed by 
the division of actual expended unit cost over budgeted unit cost. Finally 
a cost-effectiveness ratio is computed by dividing effectiveness index by 
the unit cost in a somewhat different way from the commonly used method 
that is the division of outcomes by actual expended cost. Performance 
ratio is derived from the division of effectiveness index over efficiency 
index. Specifications of each of the components and measures follow. 

Vocational Programs . The proposed model is directed toward 
analyzing cost-effectiveness of the secondary vocational program, which 
is distinguished from the academic counterpart of the program at the senior 
high school level. The vocational program includes seven program areas: 
(1) agriculture, (2) distribution, (3) health, (4) home economics, (5) 
business and office, (6) technical education, and (7) trade and industry. 
Each of the vocational program areas is classified into the sub-programs 
or courses as appeared in the Indiana State Plan (1975/ pp. 52-55), based 
on the classification of the U.S. Office of Education (See Appendix A)* 

Within the model, the vocational sub-program areas or courses arn 
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defined as "instructional programs" to be basic units of analysis. In 
other words, the proposed model is concerned with cost-effectiveness 
analyses of vocational instructional programs, such as "agricultural 
production" or "agricultural mechanics," within the agriculture program 



area. 



Program Objectives . Program objectives are defined by specified 
target goals to be attained from the vocational instructional programs 
as offered at comprehensive high schools or area vocational schools. The 
model requires that a set of program objectives be formulated by the oper- 
ating thrusts of vocational administrators at the local school district. 
Program objectives at this level would be based on the state goals and 
objectives. However, there may be differences in the local community 
demands and student characteristics by district. Therefore, they should 
reflect the program needs and requirements of the local district as well 
as statewide goals and objectives. 

It is also assumed that program objectives will be product-oriented 
and performance objectives. The model requires that program objectives 

be related to outcomes anticipated from the program in the local district. 
Furthermore, program objectives should be subdivided into targeted goals 

which are expressed in measurable terms related to degrees of attainment 

within the instructional program. 

Under these assumptions, a set of program objectives is identified 

for the project. A review of six related documents (Swanson, 1971; Coe, 

1971; Starr, 1970; Indiana State Plan, 1975; Muiti-State project, 1971; 

and Burgett, 1970) provided sources for a summary of seven objectives of 

the secondary vocational instructional program. They are stated as follows 

46 



37 



1. Aid students enrolled in vocational education to success- 
fully complete a secondary occupational program, 

2. Assist special student groups to successfully achieve in 
a secondary vocational program. 

3. Provide vocational education for secondary school youth 
in accordance with their occupational preparation - 

4. Provide leadership development activities for students 
enrolled in vocational programs through a youth organi- 
zation functioning as an integral part of the vocational 
instruction. 

5. Provide guidance and counseling services (career devel- 
opment) information appropriate to continued education 
or employment for students enrolled in vocational 
programs . 

6. Provide vocational programs to fulfill the requirement 
of the labor markets and the employment canununity man- 
power needs. 

7. Encourage vocational graduates to continue their education 
after completion of their secondary program. 

Each of these progreun objectives is described in measurable terms as to 
degrees of its attainment. For example, objective one includes a number 
of target goals indicating how many (or what percentage) of students 
enrolled in the vocational instructional program will conqplete the pro- 
gram and the degree of satisfaction with the program (See Appendix B). 

Program Costs . Program costs are defined as annual expenditures 
for operating the vocational instructional program at the local school 
corporation (district) level. Since the model is basically concerned with 
the school corporation's expenditures for the operation of the vocational 
instructional program, foregone income and the time of students while they 
are in the program, is not included in the model. Expenditures are to 
be analyzed on one-year basis without consideration of thy^ present value 
of a multi-year cost. Program costs may be divided into direct and indirect 
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costs as recommended by the U.S. Office of Education (Handbook 11, 1973). 

Direct costs of a vocational instructional program can be defined 
as expenditures directly related to the instructional program. The expend- 
itures are classified as (1) salaries, (2) employee benefits, (3) purchased 
services, (4) supplies and materials, (5) capital outlay, and (6) others 
Following this classification, in the model, the following 
six items are included as direct costs of the instructional program: 

1. Annual salaries of teaching staff within the vocational 
in'itructional program. 

2. Fringe benefits paid by the school corporation in behal. of 
teaching staff within the program. 

3. Travel costs for instruction related to the program. 

4. Costs of instructional supplies and materials v.aed by the 
program. 

5. Costs of classroom and laboratory facilities and equipment 
used by the program. 

6. Building use cost assigned the program. 

Prorated expenditures for supporting services are considered as 
indirect costs of the instru-^tional program. The supporting services 
include (Handbook II, pp. 39-48): 

1- Student support services; Activities which are designed 
to assess and improve the well-being of students and 
supplement the teaching process. 

2. Instructional staff service.: Activities associated with 
assisting the instructiondx staff in the teaching process. 

3. General administrati on servic es: Activities concerned 
with establishing and administering policy in connection 
with operating the school corporation (district) . 

School administration servinp^. Activities concerned with 
overall administrative responsibility for school operation. 
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5- Business services ; Activities concerned wi'.th purchasing, 
paying, transporting, exchanging, and maintaining goods 
and services for the school corporation. 

6- Central support services ; Activities, other than general 
administration and business s<jrvices, which support each 
of the other instructional anJ supporting services. 

Expenditures for these supporting services should be prorated to 
each of the instructional programs on the basis of appropriate criteria. 
For proration purposes, the Handbook ll illustrates applicable bases. 
They are: (1) time, (2) average daily membership or pupils enrolled, 
(3) time space, (4) time consumption, (5) .lumber of pupils, (6) mileage, 
(7) units consumed, (8) e^aployees, (9) number of transactions, or (10) 
dollars (p. 82) . The selection of one basis over another would depend 
on the types of supporting services. For analytical purposes, a simpli- 
fied method was developed to prorate supporting service expenditures 
between instructional programs. As i.>hown in Table I, expenditures for 
student services can be prorated on the basis of average daily membership 
(a::,.!) , and instructional staff services expenditures ccin be prorated by 
full-time equivalent teachers. Expenditures for general administration 
and school administration services can be prorated by full-time equiva- 
lent teachers or ADM. Both instruction hours and square feet of space 
can be used in prorating expenditures for plant operation aind maintenance, 
ADM for pupil transportation and food service expenditures, and full-time 
equivalent teachers for fiscal and internal business service expenditures. 
Central services expenditures can be prorated by ADM or full-time equiva- 
lent teachers. Specific analytical methods will be explained in "Analytical 
Forms" later. 

Program Outputs . Accordiiig to the National Center for Educational 
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TABLE I 



BASES FOR PRORATING EXPENDITURES FOR 
SUPPORTING SERVICES BETWEEN INSTRUCTIONAL PROGRAMS 



Average Full Time Square 
Daily Equivalent Instruction Feet 
Expendxture Accounts Membership Teachers Hours sgace 

Student Services x 

Instructional Staff Services x 

General Administration Services o x 

School Administration Services x Q 

Business Services 

. Operation and maintenance 

of plant ^ ^ 

. Pupil transportation and 

food service x 

. Fiscal and internal 
services 

Central Services 

. Planning, researcii, and 

staff services X 

. Statistical and data 
processing services x 



X indicates: preferred method 
0 indicates: riltemative method 



Statistics (1973), fifty-eight different educational outcomes are classified 
into a series of three phases: (1) primary effects (product consumption 
and investment, (2) secondary effects (im-.;tment and consumption feedback), 
and (3) tertiary effects (intergenerational impacts) . Clemmer, et al (1974) 
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identified performance indicators including student test results and nxjm- 
ber of students completing graduation requirements and societal indicators 
including employment rate of recent graduates (p. 3). However, program 
outputs are ciefined, in the model, by attainment of predetermined objec- 
tives as desire-i outcomes resulted from vocational instructional programs. 
Accordingly, the scot?e and contents of the program outputs are determined 
by a set of program objectives, and output indicators provide bases for 
measuring program effectiveness and cost efficiency. 

Effectiveness Mea . sures . Three numerical measures are expected 
froir the model. First/ effectiveness is defined as "a measure of the 
achievement of program objectives" (Forbes, 1974, p. 21). Program effec- 
tiveness in the model is measured by the degree of target goal attainment, 
the extent to which the goal is achieved. 

Effectiveness score is computed by dividing the actual output by 
the expected target goal. For example, if 100 percent of the enrollees 
were expected to conplete a program, but 90 percent actually completed the 
program, effectiveness score of the program indicates a 90 percent. 

Furthermore, a number of effectiveness scores can be combined into 
an effec'-.Aveness index. A composite effectiveness index is made by adding 
all available effectiveness scores. Dividing a composite index by the 
number of scores provides an average effectiveness index. If effectiveness 
scores are differentially weighted by the priority of objectives, a weighted, 
composite/ and average effectiveness index can be made lising the same 
procedure. 

Efficiency Measures . Second, efficiency is measured by the cost 
and output relationships which result in unit costs. In general, unit cost 
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is computed to indicate "resources consumed for a unit of output" (Knezevich, 
1973, p. 162). The proposed model attempts to compute unic costs as 
efficiency measures by dividing total costs of the program by units of 
the outputs, such as total number of program completions or graduates, 
unit costs por student and per student contact hour can be made by dividing 
annual total costs of the instructional program by total number of students 
enrolled in the program and by total number of student contact hours within 
the program (Molnar, 1S73; Harris & O'Fallon, 1974). 

If budgeted costs were analyzed for the vocational program, a cost 
efficiency index could be made by the computation of actual unit cost over 
budgeted unit cost for the vocational instructional program. The cost 
efficiency index indicates more or less than one. unit. 

cost-Effectiven ess Ra tio and Performance l^i-,io . The ultimate prod- 
uct of the model is to compute a meaningful cost-effectiveness ratio and 
a performance ratio. A cost-effectiveness ratio results from the compu- 
tation of program effectiveness measures over unit costs as efficiency 
measures. It indicates the degree of goal attainments per unit cost. 

As a result, the definition of a cost-effectiveness ratio would be 
somewhat different from a commonly used concept, which is determined by 
dividing outputs by the costs as inputs (Knezevich, 1973, p. 204, Handbook 
II, 1973, pi 70). The cost-effectiveness concept is lacking effectiveness 
measures and may be referred to as a cost-output ratio rather than a 
cost-effectiveness ratio. 

The performance ratio is generated from division of program effec- 
tiveness index by cost efficiency index. The performance ratio, as defined 
in the model, is no more than a precise index representing both program 
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effectiveness and cost efficienci^ together. Therefore, the ratio should 
be interpreted along with both effectiveness and efficiency implications 
in evaluating the vocational instructional program. 

Student Characteristics. The proposed model includes student 
characteristics data as input to the school system, especially in relation 
to determining program objectives and cost. The U.S. Office of Education 
suggests a classification of student characteristics into two categories: 
(1) regular students and (2) special students who are gifted and talented, 
mentally retarded, physically handicapped, emotionally disturbed, or cul- 
turally disadvantaged (Handbook II, 1973, p. 24). In addition to such 
characteristics, the model suggests proxy measures of student inputs, in- 
cluding (1) students' sex, age, and ethnic identity; (2) individual needs 
for vocational education and achievement scores, and (3) the socio-economic 
status of a student's family such as parents' education and annual income. 
These student input data are related to the specification of pr^ogram objec- 
tives and will be used in interpreting student outputs and tiie rasults 
from cost-effectiveness analyses. 

Community Demand and Support . As external factors to the school 
system, community demand and support for secondary vocational programs are 
included in the model. Conanunity demand identifies population trends, 
mobility of residents, and manpower needs. The level of economic resources 
and willingness to support a school system determine the amount and quality 
of human and material resources which may operate the system's vocational 
programs. These community resources and sijpport would be measured by an 
average income level and distribution among the residents, and tax rate 
for education and/or voting behavior on educational bonds for vocational 
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programs. 

Economic and Non-Econ omic Benefits . Conceptually concerned with 
long-range outputs of the school system, the model suggests the consider- 
ation of the effect of schooling on economic benefits such as earnings, 
employment and occupational improvements . It also suggests that non- 
economic benefits of long-range outputs be measured by the degree of 
"participation in governraental affairs, crime rates, and number of public 
assistance recipients" (Rossmiiler & Geske, 1976, p. 500). 

Feedback . The final consideration of the cost-.-f fectiveness analy- 
sis model is the feedback loop and input-output relationship in operating 
vocational programs. As a self- correcting mechanism, feedback relates 
educational effects to community demand. and support for the evaluation and 
planning of vocational programs. Programs also can be evaluated within 
the input-output relationship by measuring changes in students before-after 
program operation at the school level and/or by assessing community-wide 
input-output relationships for the program operation. 

As mentioned above, the proposed model consists of four major 
components, three measures, three additional factors, and feedback. Basic- 
ally concerned with drawing three cost-effectiveness measures, however, 
primary effort will be given to developing data types, instruments and 
analytical forms for the first four major components within the nodel. 

DATA INSTRUMENTS AND FORMS 

The implementation of cost-effectiveness analysis requires appro- 
priate data pertaining to each of the conponents. The specified data 
types provide a base for developing data collection instruments and analy- 
tical forms. 
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Data Types 

Data types are specified for cost-effectiveness analysis of secon- 
dary vocational programs. Data are i.^entified as program objectives and 
outputs, costs, and student and community characteristics. 

Data for Program Objectives and Outputs . The proposed model is 
rected toward evaluating cost-effectiveness of vocational programs at 
the secondary school level. Evaluation of the program object,! ves and 
outputs will require data on enrollees and completions from the vocational 
Mxstructional program, academic achievement, and follow-up information 
on' ecployment and advanced studies after graduation. 

With regard to Objective One, as specified in the model, data will 
be required on enrollment, program completion, graduation, dropouts, and 
satisfaction of students with the program (s) completed. For Objective 
Two, data will be required on special student groups relative to enroll- 
ment, coitpletions, ai^d program satisfaction. Follow-up data on employment 
of graduates and satisfaction with occupational preparation and the job 
in relation to the program will be needed for Objective Three. For Objec- 
tive Four, records on student participation in leadership development 
activities and satisfaction with the participation will be required. Data 
on guidance and counseling services and career development information as 
provided to students will be required to meet Objective Five. For Objec- 
tive Six, data will be I'eqiiired on graduates' en^loyment within and outside 
the community which the school serves, community manpower demands infor- 
mation, and employers* opinion on vocational training of en^loyees. Finally, 
for Objective Seven, data on graduates' advanced studies at post-secondary 
institutions will be required. 
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In conjunction with the objective data, actual attairu-aent records 
and information will be needed for identifying output indicators of the 
program. Data on both the objectives and outputs will be required in 
measuring program effectiveness. 

Data for Costs. Program costs include both direct instructional 
costs and indirect supporting services costs. Direct costs will be con- 
c^med with those expenditures related to providing instructional services, 
such ds salaries and fringe benefits of the teaching staff, travel expenses, 
instructional supplies and materials, classroom and laboratory facilities 
cind equipment, and building costs. 

-^he determination of indirect supporting services costs will require 
broader information on expenditures for supporting services and allocation 
bases which may be used for prorating indirect costs to the direct cost 
of vocational instructional programs. Indirect costs will be those expen- 
ditures incurred in supporting instructional activities-, such as pupil 
services, instructional staff services, general administration, school 
administration, business services, and central services. For allocation 
purposes the following data will be needed, (i) average daily atten- 
dance or average daily membership, (2) number of student contact hours , 
(3) number of full-time equivalent teachers, and (4) square feet of build- 
ing space for the instruction. 

Cost data are classified according to the accounting system recom- 
mended by the U.S. Otfice of Education, which is also adapted to the State 
of Indiana. The quantity of cost data to be collected for a cost-effec- 
tiveness analysis may vary with decision situations from a minimum of the 
direct -assignable program operational costs to a maximuir. effort for 
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collection of all capital and operating costs of the school system. When 
evaluating an individual vocational program or comparing more than two 
programs within a school, it may not be necessary to consider capital out- 
lays. However, if trie cost-effectiveness is to be used in making decisions 
pertaining to comparison of vocational programs among schools, or selection 
of new programs which may need new facility acquisitions, then capital 
costs must be considered. Thus the amount of cost data required will be 
a function of the decision situations as well as the purposes of the cost- 
effectiveness analysis . 

Data for Student and Community Characteristics . As the program's 
target population, student characteristics data will be required not only 
for determining the program objectives, but also for interpreting the 
analytical results. Student characteristics data include personal data 
such as age, sex, previous vocational training, educational goals, atti- 
tude toward school, job experience before school, and future job expecta- 
tions; and family background including parents' race, educational level,, 
expectation of children's education, and job and income level. For pro- 
grams which serve a small target population, it may be desirable to collect 
characteristics data on all students. In other cases, especially for 
follow-up information, a sample of students would be sufficient for an 
analysis. 

Data on community characteristics external to the school system 
will be needed for the design and operation of the program. Identifiable 
characteristics of the community within which a vocational program operates 
are, for exaitiple, community demands and financial support for vocational 
education. The sources of data concerning community demands for vocational 
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education include population characteristics such as annual growth, age 
distribution, sex and ethnic group ratios and employment data about the 
size of the labor force, unemployment ratio, and manpower demand projec- 
tions. On the other hand, financial support for vocational education 
can be measured: (1) by the family income level and the extent of revenue 
along with tax rates, (2) by changes in the level of support over a period 
of time with consideration of inflationary factors, and (3) by approval 
of bonds issued by the school corporation for the support of vocational 
education programs. 

Both student and community characteristics data may not be consi- 
dered in cost-effectiveness analysis as far as the analytical technique 
is concerned with the cost and effectiveness aspects of the instructional 
program. As previously indicated, however, it would be unwise to set 
forth program objectives without the student and community characteristics 
data base. 

Data Collection Instruments 

The data types identified have been combined into a set of five 
data collection instruments, which are attached as Appendix C. Some pre- 
viously developed instruments for use in collecting student and community 
characteristics data were suggested. 

school Corporation (Dis trict) Information (I) . The instrument was 
designed to collect general information on total number of average daily 
membership, school hours, student contact hours, full-time equivalent 
teachers, and building space for instruction as a whole. 

Secondary Vocational Instructiona l Program Data (II) . Instructional 
program data were focused upon student enrollments and completions, student 
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participation in youth organizations and ^ancillary services. 

Students' Follow-up Program Rating Scale (III) . The questionnaire 
was developed for the graduates to rate the vocational instructional pro- 
gram which had been completed. Primary attention was directed toward • 
satisfaction with vocational training, job preparation, present job, youth 
organization activities, ancillary services, and/or preparation for advanced 
studies. 

Employer s' Opinion on Vocational Training of Employees (IV) . The 
questionnaire was designed to explore employers' opinions about the skill, 
knowledge and abilities of employees who completed the vocational training 
program, as well as employment policies dealing with employees trained in 
vocational programs . 

Vocational Instructional Program Cost Data (V) . Total budget and 
expenditures incurred in instruction and supporting services of the school 
corporation can be collected according to the accounting system recommended 
by the U.S. Office of Education (Handbook II). If the school corporation 
does not adopt this accounting system, careful consideration has to be 
given to assigning appropriate cost items to instruction and supporting 
service categories- Instructional direct cost items of a vocational in- 
structional program include salaries and fringe benefits of teaching staff, 
travel expenses for instruction, instructional supplies and material costs, 
classroom furniture and laboratory equipment costs, and building use costs 
for instructional purposes. Indirect supporting services costs include 
total expenditures for (1) student services, (2) instructional staff ser- 
vices, (3) general administration, (4) school administrations, (5) business 
services, and (6) central services, as provided by the school corporation. 

Student and Commu nity Characteristics Data . Student characteristics 

59 



50 



data can be collected, using the high school student's questionnaire pub- 
lished by the Department of Health, Education, and Welfare (Thompson, 1974) 
Following social indicator forms developed by the Executive Office of the 
President (1973) , community characteristics information may be collected. 
The student and coimnunity characteristics data were not directly related 
to cost-effectiveness analysis, but it was suggested that the data be used 
in determining program objectives and interpreting the analytical results 
from the cost-effectiveness study. 

Analytical Forms and Techniques 

Vocational instructional program and follow-up data will be analyzed 
for identifying program target goals and associated outputs to determine 
program effectiveness measures. Cost data will be treated to identify 
direct instructional costs and indirect supporting services costs of a 
vocational program. Specific analytical forms and techniques were devel- 
oped for (1) program effectiveness analysis, (2) program cost analysis, 
and (3) cost-effectiveness measures. 

Program Effectiveness Analysis. First, a program objective and 
output data unit is identified by factor unit over basic unit of the 
specific target goal. For instance, the target goal of Object 1-b can 
be set forth by dividing number of students who are expected to complete 
(factor unit) by number of students enrolled (basic unit) and multiplying 
the result one hundred times as illustrated in Table II. 
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TABLE II 



AN ILLUSTRATION OF PROGRAM OBJECTIVES 
AND OUTPUT DATA UNIT 



Objective 1-b 



Basic Unit 



Factor Unit 



Target Goal 



percent of 

the students will 
complete the 
program requirements 



Number of 

students 

enrolled 



Number of 
students to 
complete 



Factor Unit 
Basic Unit 



X 100 = 



% 



Second^ the target goal of Objective 1-b is compared with the actual 
output to identify the degree of goal attainment, that is, a program effec- 
tiveness score. The program effectiveness analysis procedure is illus- 
trated in Table III. Effectiveness score is measured by a percent of 
actual output over the target goal. The score, if necesseiry, can be weighted 
as COTpared with other goal statements, then it will be adjusted to a weight- 
ed value. 

Furthermore, if there are two or more effectiveness scores, all 
effectiveness scores can be combined into a composite effectiveness index. 
Dividing the composite effectiveness index by number of scores will pro- 
duce cin average effectiveness index. If the effectiveness scores are 
weighted r then a weighted composite effectiveness index and weighted aver- 
age effectiveness index can be coKiputed in the scime way. 
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TABLE III 

AN ILLUSTRATION OP PROGRAM EFFECTIVENESS ANALYSIS 



Objective Target Actual Effectiveness Weighted Valu e 
^ 2H£Eit Score Weight Adju";^scorc 

percent 

of the stu- 
dents will Actual 
complete the pargeted ^ 

proper require- 
ments 



Cost Analysis, A total cost of a vocational instructional program 
is computed by direct costs of instruction plus supporting services indi- 
rect costs prorated to the program. First, direct costs of instruction 
include the following items: 

^- ^'"""al sal aries p _f teaching staff with in the instructional pro- 
aram. Actual annual salaries of teaching staff, including substitute and 
temporary teachers, are assigned to the instructional program. A total of 
salaries assigned to the program can be computed on the basis of teaching 
time alloted to a given instructional program, using the following formula: 



n 

AAS 2^ Si • Ti (%) 

n=l 



Where, AAS: Actual Annual Salaries of teaching staff 
S^: Annual salary of individual teacher 
Tj^: % of teaching time alloted to a given 
program 

An alternative method is to multiply average annual salaries of all voca- 
tional teachers by full-time equivalent teachers (FTE) within the instruc- 
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tional program. An average annual salary is equal to the amount generated 
from total annual salaries of all vocational teachers over total of full- 
time equivalent teachers. Accordingly, actual annual salaries paid for 
the program are expressed by: 

AAS = fte • (or Average Salary) 

PTE 

Where, AAS: Actual annual salaries of teaching staff 
fte: Full-time equivalent teachers within the 
program 

TS: Total of annual salaries of all vocational 
teachers 

FTE: Total of full-time equivalent vocational 
teachers 

2- Fringe benefits for teaching staff within the instructional 
program . Fringe benefits of teaching staff are accounted for by certain 
amounts of the fringe benefits paid by the school corporation in behalf 
of teaching staff within the program. Two methods are available in com- 
puting the amount of fringe benefits. The first method is to add actual 
amounts paid by the school corporation for retirement contribution, health 
and/or life insurances of teaching staff, and other benefits. A total of 
fringe benefits paid by the school corpo::ation is computed by: 

n 

FB = H (RCi + Hl^ + Lli + Oi) 
i=i 

Where, FB: Fringe benefits assigned to the program 
RCj_: Retirement contributions to individual 

teachers within the program 
HI^: Health insurance pensions paid for 

individual teachers within the program 
LIj_: Life insurance pensions paid for 
individual teachers 
0^: Other benefits paid for individual 
teachers within the program 
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The second method is to multiply total actual salaries assigned to the 
program by a certain percent for fringe benefits paid by the school cor- 
poration as follows: 

FB = AAS • xP (%) 

Where, FB: Fringe benefits assigned to the program 
AAS: Actual salaries of teaching staff within 
the program 
xP(%): Certain percent of the salaries for 
fringe benefits 

^- Travel co sts for instruction . Travel costs are the annual 
amounts of mileage expense and per diem paid to instructors who traveled 
and student field trips for instructional purposes in relation to the 
program. A total amount of instructional travel costs is computed by: 



n 

TC = 



XI [(Mi • Vmi) + (Di . $/di)] +yi FT. 
i=l 3^1 3 

Where, TC: Travel costs for instruction 
Mji^: Total mileage of individual 
instructors 
^/niji^ : Cents per mileage 

Dj^: Total travel days of individual 
instructors 
$/dj|^: per diem 
FTj : Annual costs of student field 
trips 

^- Costs of -instructional supplies and materials assigned to the 
instructi onal programs . These costs are expenditures for consumable sup- 
plies and other materials for instructional purposes. If expenditures 
for instructional supplies and material? are allocated to all vocational 
programs, the expenditures should be prorated to each of the instructional 
programs on the basis of student contact hours. The proportion of instruc- 
tional supplies and materials costs can be formulated by the following: 
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ISMC = — .sch — . 
SCH 

Where, ISMC: Instructional supplies and material costs 
for a given instructional program 

sch: Student contact hours for a given instruc- 
tional program 

SCH: Total student contact hours of the voca- 
tional program 

(C) : Total expenses for instructional supplies 
and materials for the vocational programs 

5. Costs of classroom and laboratory facilities and equipment used 
by the instructional program . These costs are total amounts of yearly 
depreciated costs of classroom and laboratory facilities and equipment 
used by the instructional program. Depreciated costs can be estimated by 
dividing original cost by life expectancy. If the use of facilities and 
equipment is shared with other instructional programs, the annual costs 
should be prorated to a given program on the basis of percentage of use 

in the program. Actual annual costs can be computed as follows: 

n 

FEC = JZ • X(%)i 

i=l ^i 

Where, FEC: Actual annual costs of classroom cind 

laboratory facilities and equipment used 
by a given instructional' program 
OC^: Original cost of ii;ains 
y^: Life expectancy of items 
X(%)i: Percentage of use of a piece of equip- 
ment for a given instructional program 

6 . Building use costs assigned to the instructional program . Thi s 
is the cost of using a building by the instructional program for a fiscal 
year. The building use cost is determined by dividing the original cost 
by life expectancy (Handbook II, p. 168), as follows: 
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BUG = -9£— 
Y 

Where, BUG: Building use cost for a year 
OC: Original cost of vocational 
building 
Y: Life expectancy 

For actual building use cost for a given instructional program, the annual 
cost of the vocational building should be prorated to the instructional 
program on the basis of percentage of space and time used for the program. 
Annual actual building use cost of a given program is expressed by: 

AABUG = AG • • CG) 

(B) (D) 

Where, AABUG: Actual annual building use cost of 
the instructional program 
AG: Total annual cost of vocational 
building 

(A) : Square feet of building space used 

by the instructional program 

(B) I Total square feet of vocational 

building space 
(G) : Inst:ruction hours for a given program 
(D) : Total instruction hours for the 

vocational programs 

A sum of all costs of the six items accounts for the instructional 
direct costs. When evaluating one program within a school or comparing 
two or more programs in the same school, building use cost may be excluded 
from the direct cost of the instructional program. 

Next, supporting services indirect costs can be prorated to the 
instructional program throiigh the following procedures: 

1- Student support service costs prorated to the vocational instruc- 
tional program. These costs include expenditures for (1) attendance and 
social work, (2) guidance, (3) health, (4) psychological, and (5) speech 
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pathology and audiology services for improving the well-being of students 
and supplementing the teaching process. Total amounts of expenditures 
for student services can be prorated to the instructional progrfim on the. 
basis of average daily membership (ADM) , using the following formula; 

PSSC = • (C) 

ADM 

Where, PSSC: Prorated student serviced costs 
to a given pi. jram 
adm: Average daily membership in the 

irstructional program 
ADM I Total average daily membership 

of school corporation 
(C) : Total expenditures for student 
services of school corporation 

2. Instructional staff services costs prorated to the instructional 
program . These costs are amounts paid for those activities associated 
w^h (1) improvement of instruction and (2) educational media services 

for assisting the teaching staff. Total expenditures for instructional 
staff services of a school corporation can be prorated to the instructional 
program on the basis of full-time equivalent teachers by use of the fol- 
lowing formula: 

PISSC = • (C) 

FTE 

Where, PISSC: Prorated instructional sta:^f services 

costs for a given inst;ructional program 
fte: Full-time equivalent ^eacners for the 

instructional program 
FTE: Total full-time equivcilanf, teachers 

within school corporation 
(C) : Total expenditures for 3 ;istructional 
staff services of school corporation 

3. General administration services costs prorated to the instruct 
tional program . These costs are amoui"rts paid for services concerned with 
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establishing and administering policy in connection with operating the 
school corporation, including board of education services and executive 
administration services. General adninistrative costs can be prorated to 
the instructional progvam on the basis of full-time equivalent teacher 
as shown in item 2, above. 

School a dministration services co s ts prorated to the instruc- 
tional program. These costs are amounts paid for services concerned with 
overall administrative responsibility for a school operation such .as the 
principal's office services. School administration services costs can be 
prorated to the instructional program on the basis of average daily mem- 
bership as shown in item 1, above. 

5' Business services cost prorated to the instructional program . 
These costs are .^jnounts paid for activities concerned with purchasing, 
transporting, and maintaining goods and services. For analytical purposes < 
business services costs can be categorized into (1) operation and main- 
tenance of plant, (2) pupil transportation and food services, and (3) 
fiscal, and internal services for operating all schools, and can be pro- 
rated to the instructional program vising a different prorating basis for 
each category of services. 

The proration of costs for operation e.nd malnterance of plant can 
be based on proportion of space and time used in tii^. inr.cructional program. 
Prorated plant operation and maintenance costs are estimated by: 

PPOliC = ^ • • (E) 

(B) (D) ^ ' 
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Where, PPOMC: Prorated plant operation and 
maintenance costs for a given 
instructional program 

(A) : Square feet of building space used 

by the instructional program 

(B) : Total square feet of building 

space of school corporation 

(C) : Instruction hours for the program 

(D) : Total instruction hours of school 

corporation 
CE) : Total amounts paid for plant oper- 
ation and maintenance of school 
corporation 

Amounts paid for pupil transportation and food services can be 
prorated to the instructional program on the basis of average daily mem- 
bership (ADM) as shown in item 1, above; whereas amounts paid for fiscal 
and internal services can be prorated to the instructional program on the 
basis of full-time equivalent teachers as shown in item 2, above. A total 
of the prorated costs of these three categories represents business ser- 
vices cost prorated to the instructional program. 

6. Central support services costs prorated to the instructional 
progrcim . These costs are amounts paid for services of (1) planning, 
research, evaluation, and staff services, and (2) statistical and data 
processing services, from the central office. For the first category of 
services, the number of full-time equivalent teachers Cein be used in pro- 
rating total amounts paid for the services to the instructional program- 
in the same way as shown in item 2; whereas average daily membership (ADM) 
can be used in prorating amounts paid for the second category of services 
to the instructional program using the same method as shown in item 1. 

After these prorating procedures are completed, the prorated costs 
of all supporting services are added to the supporting indirect costs of 
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the instructional program. The s\m of direct and indirect cost represents 
a total cost of the voc rational instructional program. Based upon the 
annual budget, total costs of vocational programs can be made by repeating 
the same proce^'ures as mentioned above. These costs may be called budgeted 
total costs of vocational programs. 

Finally, actual total costs of vocational programs can be analyzed 
to produce unit conts as efficiency measures. Unit cost per completion 
or graduate, per student enrolled in the program, or per student contact 
hour can be computed by dividing total cost of the instructional program 
by total number of completions or graduates, students, or student contact 
hours. In addition, a budgeted unit cost can be computed for the program. 
By dividing actual unit cost or total cost by budgeted unit cost or total 
cost, a cost efficiency index will be produced. 

Cost-Ef fectiveness Measures . Procedures for computing cost-effec- 
tiveness measures are expressed by the following formulas: 

First, Program Effectiveness (PEj|^) scores are derived by dividing 
outputs (Oj^) over the target goals {G^) , or 

P^i Q — (Formula 1) 

i 

A number of program effectiveness measures can be added to a Coit^osite 
Program Effectiveness (CPE) index, and an Average Program Effectiveness 
(APE) index can be derived by dividing the composite index by a number of 
effectiveness scores (N) . They are expressed by: 



CPE = 




(Formula 2) 
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n 

H 

i=l 



APE = 



(Formula 3) 



If each program effectiveness is weighted on the basis of policy prefer- 
ence or importance of program objectives, then a Weighted Composite Program 
Effectiveness (WCPE) , and a Weighted Average Program Effectiveness (WAPE) 
index can be made as follows ; 



WCPE = 2Z 



n 0. 



i=l 



W. 
1 



(Formula 4) 



WAPE = 



n 

H 

i=l 



W, 



i=l 



W, 



(Formula 5) 



Second, Actual Cost Efficiency (CE^^j) measures are made by dividing 
actual total cost of the program (C^^j) by unit of outputs, such as total 
number of completions (0^) , students enrolled in :he program (O2) , or 
student contact hours (0^)- Each of the products is called actual unit 
cost (UC (a) ) - It is : 

C, 



CE 



(a) 



(a) ^(a) or UC 



02 



03 



(a) • - • (Formula 6) 



In the same way, Budgeted Cost Efficiency (CE^j^j) measures are made by: 



CE 



(b) 



(b) ^(b) 



■(b) 



O3 



, or UC(j3) ..^(Formula 7) 



By comparing formula six with seven, a Cost Efficiency Index (CEI) is made 
aa follows: 
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CEI = , ^(a)/°2 , ^(a)/03 "^(a) 

C<b)/Ol C(i3)/02 C(i3)/03 ' UC(b) 

C/wx ' (Formula 8) 

Finally, based upon the measures of program effectiveness and cost 
efficiency, a cost-effectiveness ratio and a performance ratio can be 
computed, A Cost-Effectiveness Ratio (C/ER) is derived by: 

C/ER = (1). (2). ( 3), (4), or (5) ^ 

(Formula 9) 

The ratio indicates the degree of goal attainments per unit cost, A 
Performance Ratio (PR) is generated from the division of program effec- 
tiveness by cost efficiency index as follows: 

PP - (1). (2), (3). (4), or (5) 

(8) (Formula 10) 

This performance ratio indicates more or less than one unit, and repre- 
sents the relationship between the program effectiveness and cost effi- 
ciency as measured by formulas one through nine, 

COST-EFFECTIVENESS MODEL: PROCEDURES 

■ A standard procedure was developed for using the cost-effectiveness 
analysis model based upon three selected studies. The procedure consists 
of seven steps within three phases: CI) planning a cost-effectiveness 
analysis, (2) implementing the analysis, and (3) utilizing the results 
from the analysis (See Figure , 

Burgett (1970) developed a procedural model consisting of six steps t 
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(1) determination of program objectives, (2) identification of pertinent 
behavior, (3) development of effectiveness and cost measures, (4) data 
collection, (5) analysis, and (6) appraisal (p. 36). Pearson (1972) 
classified the process of cost-effectiveness analysis into two categories. 
(1) a model building in a stepwise procedure and (2) application of a 
particular model to a real-world practical situation in an input, analy- 
sis, and output scheme (p. 35). Forbes (1974) divided cost-ef fecVivenf is 
data analysis into three phases: (i) planning before the collection of 
data, (2) monitoring during the collection of data, and (3) analyzing 
after data collection. The literature was synthesized to develop a stan- 
dard procedure for using the cost-effectiveness analysis model. 

Administrative awareness and commitment to use of the cost-effec- 
tiveness analysis model will encourage the staff to develop a plan for 
a cost-effectiveness analysis. After implementing the analysis, the 
administrator will utilize the results in the decis'V,a making process 
pertaining to program evaluation, development, and ...ng . A deliberate 

effort for specifying each step within each phnsK Jfci.lo'i'.-. 

Planning a Cost-Effectiveness Analysis 

The planning phase includes the determine tVo,.". or' -he purposes of 
a cost-effectiveness analysis, identification of .4,:,.ropriate resources 
for attaining the purposes, and development of a st'udy pla.u 

Determi nation o f P grposes of. the Ai-aly sis. 'n,e first step is -.o 
determine analytical purposes for usi/,g the model. The need to conduct 
a cost-effectiveness analysis will be discussed in determining che pur- 
poses of the analysici. Oio obtain available information specific to some 
decisio". situacions, anticipated information from the analysis and the 
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scope of the analysis should be defined. Based on the need and scope of 
the analysis, analytical purposes will be specified tox improving program 
operation, providing information needed in decision-making and/or improving 
public understanding and support for vocational programs. The identified 
needs / scope, and purposes will be summarized irii.o a request for a cost- 
effectiveness study- 

Identif ication of Appropriate Resources . The next step in the 
planning phase is to identify personnel and fi:-r:al resources required for 
implementing the analysis- A cost-effectiveness analysis r:sguires a study 
team consisting of appropriate personnel to coiitiuct the analysis and ade- 
quate ::;taff for the assignment of responRxo:'. litj.es to gcither data. To 
aid in achieving staff participation, the follovj.ag iAp;:i*oaches are sug- 
gested: (1) in-service training sessions whic.]i uar i;r.^ctical problems as 
examples of hw cost-effectiveness analysis can be u^ed; (2) involvement 
of key sftaff members in a decision-making process which necessitates the 
use of cost-effectiveness analysis; (3) and c/cvaonst ration by administrators 
that cost-effectiveness can be used t ? reach better decisions in the plan- 
ning and operation of the school (Forb<j^, 1974, p, 26). If it is neces- 
sary in planning the analysis, an advisory committee including representa- 
tives of the board, teachers, parents, and business should be organized. 
The study team should invite consvlr-c^r'.ts from professional agencies to 
provide technical assistance* 

FiiiiTricial resources should be icV-intified to support the analysis 
on the time and performance basis. The chief administrator's commitment 
to tile use of cost-effectiveness analysis in a decision-making process will 
be reflected in the establishment of a budget to help the implementation 
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of the analysis. 

Development of a Study Plan , After a study team is organized, an 
analytical study plan will h^-i developed. The plan will include a design 
of the study and a time, schedule as a flow of procedural activities over 
time. A design for the cnj/lytical study will be developed on the basis 
of the request for study. Wn^n the analysis is addressed to certain deci- 
sion situations, the needs and anticipated information will be specified 
in defining the objectives of the study. To reach the objectives, data 
types and required data, and analytical forms should be identified in the 
design. 

A time schedule for the study will be developed to include the 
procedural activities from start to completion of the study. Appropriate 
time should be allocated to data collection, analysis, interpretation, 
and writing a final report. 

Implementing a Cost-Effectiveness Analysis 

As scheduled in the plan, a cost-effectiveness analysis will be 
implemented. The implementing phase consists of two steps: (1) collec- 
tion of data required for cost-effectiveness analysis, and (2) computation 
of the resulting measures. 

Collection of the Required Data . Data required for each of the 
components essential in cost-effectiveness analysis will be collected and 
analyzed, and the resulting measures will be computed. First, student 
school records and follow-up data on identified programs for analysis will 
be reviewed to identify program objectives. Program objectives will be 
specified in measurable terms as target goals. Considering the program 
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relativeness, policy preferences, and data availability, a number of 
objectives and specified target goals will be selected from among the 
seven objective categories developed in the model. Already assigned 
target goals will be identified; otherwise, appropriate target goals will 
be set forth by the authority. Second, program output data will be col-- 
lected in accordance with program objectives. The predetermined program 
target goals and the actual outputs will be used for computing various 
program effectiveness measures. Third, specific cost elements of a 
vocational program will be identified and appropriate costs be assigned 
to each of the cost elements. When the focus of the cost-effectiveness 
activity is directed to the specific program, the direct costs will be 
allocated to directly related elements and indirect costs will be prorated 
to the program. Then, additional data on student characteristics within 
the program and selected related community characteristics data will be 
collecced for use in interpreting results of the analysis. 

Instruments developed in the model will be used for collecting 
the required data on program effectiveness and cost analysis. Another 
task along with data collection is a monitoring activity which will be 
performed to ensure that the most reliable data possible are collected. 
Any problems found during the data collection should be explicitly re- 
corded for further consideration. 

Computation of Measures . Following the data collection step, ana- 
lytical techniques will be executed to identify program effectiveness 
measures, cost efficiency measures, and a cost-effectiveness ratio and/or 
performance ratio. As previously discussed, program effectiveness scores 
will be computed as measures of program goal attainments. Scores will be 
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combined into an effectiveness index, cost efficiency will be mea i-. 
by computing unit cost per student, per student contact hour, or per 
completion or graduate. Furthermore, a cost efficiency index will be 
formulated by the ratio of actual unit cost over budgeted unit cost' of 
the program under study. Finally, a cost-effectiveness ratio will be 
computed by dividing the program effectiveness index by the unit cost. 
In addition, a performance ratio will be drawn from the division of the 
program effectiveness index by the cost efficiency index. 

Utilizing the Results from the Analysis 

After the analysis is finished, a study report will be ipade to 
decision-makers so that they may utilize the results in decision-making. 

Preparation of a Study Report. The resulting cost-effectiveness 
measures should be interpreted with consideration of additional infor- 
mation concerning student and community characteristics. Through dis- 
cussion of the results and interpretation among the concerned people, 
conclusions and recommendations will be drawn. Then, a final report will 
be made to decision-makers. 

Utilization of the Results. Based upon the reported conclusions 
and recommendations, analytical results will be utilized for program 
evaluation, development, and planning. For a program evaluation, cost 
information will be related to program effectiveness. It will be pos- 
sible to determine what cost increases will mean to the degree of program 
effectiveness at different time periods. Conversely, the program effec- 
tiveness v..-ili be related to each of the cost items associated with the 
program in order to identify cost items leading to cost increases for 
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the program. Cost efficiency and program effectiveness will be compared 
on the basis of a cost-effectiveness ratio or a performance ratio. 

The analytical results and conclusions will be used in developing 
new programs. Cost-effectiveness measures will provide decision-makers 
with information on the need for new program development. If a program 
is identified as being very ineffective and. inefficient , a judgement 
should be made that the program should be modified or deleted. Based 
upon the information, final decisions will be made to develop strategies 
either modifying the program or developing a new alternative program. 

For program planning, the analytical results and recommendations 
will provide a basis for future planning for the improvement of voca- 
tional programs. A short-range (one or two-year) plan will be made for 
increasing program effectiveness and/or cost efficiency. To improve 
overall vocational programs, a long-range (five-year) plan will be devel- 
oped from long-time perspectives. 

SUMMARY 

A conceptual model was developed for use in analyzing cost-effec- 
tiveness of secondary vocational instructional programs. The proposed ' 
model was focused upon relating four major components: (1) vocational 
programs, (2) objectives/target goals, (3) costs, and (4) outputs; and 
generating three measures: (1) program effectiveness, (2) cost efficiency, 
and (3) a cost-effectiveness and performance ratio. The primary effort 
was to define the conceptual and technical procedures involved in the 
model . 

Based upon the specified data types needed for a cost-effectiveness 
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analysis, a set of five data collection instruments was developed: (1) 
School Corporation (District) Information; (2) Secondary Vocational In- 
structional Program Data; (3) students' Follow-up Data; (4) Employers' 
Opinion on Vocational Training of Employees, and (5) Vocational Instruc- 
tional Program Cost Data. Analytical forms and techniques were developed 
along with the formulas for computing cost-effectiveness measures. 

Finally, a standard procedure for using the cost-effectiveness 
analysis model ar.d instruments was conceptualized into seven steps within 
three phases: (1) planning a cost-effectiveness analysis; (2) implement- 
ing the analysis, and (3) utilizing the results from the analysis. The 
procedural scheme will be applied to guide locally directed cost-effec- 
tiveness studies, which will be conducted by vocational administrators. 
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Evaluation of the Products and Concfusions 

The cost-effectiveness analysis model and instruments were reviewed 
and examined by both research and evaluation experts and field personnel 
to increase their usefuljiess. Throughout 'the procedure, conclusions were 
drawn along with reconunendations and suggestions for further studies • 

EVALUATION OF THE PRODUCTS 

To increase the usefulness of the cost-effectiveness analysis model 
and related data collection instruments/ primary attention was focused 
upon (1) a review of the model/ (2) a revision of instruments/ and (3) an 
examination of the cost-effectiveness measures- 

Review of the Cost-Effecliveness Analysis Model 

The cost-effectiveness analysis model, including major components, 
was reviewed by the project's Advisory Committee and National Advisory 
Panel. The Advisory Committee, constituted of Indiajia educational per- 
sonnel, consisted of three local vocational directors, three state level 
vocational officers and a university professor of vocational education. 
Four university professors of research and evaluation and two research 
and management specialists in vocational education studies constituted 
the National Advisory Panel for the cost-effectiveness project. 

The Advisory Committee was concerned with (1) applicability of the 
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model to local program studies, (2) specification of the program objec- 
tives, (3) appropriateness of the cost analysis system, and (4) validity 
of the data collection instruments- The National Advisory Panel was 
directed to the same major tasks of the Advisory Committee- The National 
J.'anel devoted attention to the validity ana appropriateness of the pro- 
posed model for cost-effectiveness studies of vocational programs- 

The seven objective categories and target goals wi;re reviewed and 
approved by the Advisory Committee (Appendix B) - The National Advisory 
Panel endorsed the objective and target goal concepts and specifications. 

The National Advisory Panel members were primarily concerned with 
the measurement of a cost-effectiveness ratio- In the initial draft, a 
cost-effectiveness ratio was defined as the relationship between a program 
effectiveness index and a cost efficiency index- Some objection was 
raised to the proposed definition of the cost-effectiveness ratio, and 
the following formula was suggested by some panel members to con5)ute a 
performance index: 

Actual Ou tput/Actual Cost 
Planned Output/J? .anned Cost " Index - - - (Formula a) 

However, the formula could be reformed as 

Actual Output/Planned Output 

Actual Cost/Planned Cost (Formula b) 

If the planned output were referred to as program. obDectives , and pie.nned 
cost were the same as budgeted cost, so defined in the mof.al^ ^then the 
modification would result in no difference in mathematical procedure 
between the suggested formula and the model- However, the product from 
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formula a was considered as "performance index;" whereas formula b 
was developed int<^; 



Effectiveness Index , » 

— : — ^ (Formula c) 

Efficiency index 



whose product was called "cost-effectiveness ratio" in the model. 

Since some confusion may have resulted in using the terms perfor- 
mance index and cost-effectiveness ratio, the "cost-effectiveness ratio 
was redefined by the division of the effectiveness index over actual unit 
cost, and the product from formula c was called a "performance ratio." 
The National Advisory Panel accepted the proposed changes. The Advisory 
Committee endorsed the model's appropriateness to vocational program 
management in Indiana. 

Revision of Data Collection Instruments 

Drafts of data collection instruments were presented to the Advisory 
Committee and National Panel members. Additionally, local vocational di- 
rectors and business managers within the same school corportitlon examined 
the set of data collection instruments in terms of data availability, 
ease of collecting data, and item arrangement. Based upon the suggestions 
and comments provided by advisory members and field personnel, raw-data 
collection forms were revised inuo simplified forms to collect data from 
school corporations. 

Two instruments for collecting student input data and community 
characteristics data were eliminated from the set of instruments. These 
instruments would have duplicated measures already in use and would have 
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forced standardization of measures that should remain highly specific to 
the community. Previously developed high school student questionnaires 
and community data forms in use with school corporations were suggested 
for collecting both student and community characteristics data. 

The Advisory Committee meeting, after reviewing the revised instru- 
ments accepted them with minor changes. The National Advisory Panel's 
recommendation to simplify the instrumentation was incorporated. The 
finalized data collection instruments are attached as Appendix C. 

Examination of Cost-Effectiveness IMeasures 

^Vhen evaluating vocational programs using the cost-effectiveness 
analysis model, measures are expected to provide answers to three primary 
questions: (1) Is the program effective, or .to what extent have the pro- 
gram objectives been achieved? (2) How efficient is the program? and 
(3) Does the program perform in an effective and efficient manner? To 
investigate these questions, cost-effectiveness measxires developed in the 
model were examined using hypothetical data. 

Suppose three vocational instructional programs (a, B, and C) were 
selected from among the vocational programs within an area vocational 
school for analysis. At the beginning of the school year, progrcu.! objec- 
tives would be specified by three target goals of each program: (i) number 
of expected completions, (2) percentage of passing licensure examinations, 
and (3) percentage of expected enployment. After program operation, pro- 
gram outputs were identified by actual attainments and associated with 
each of the target goals. Also, program costs were analyzed to identify 
both actual and budgeted costs for each instructional program. The 
hypoth.etical data were as shown in Table IV. 
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TABIiE IV 

HYPOTHETICAL DATA FOR A COST-EFFECTIVENESS ANALYSIS 



Data 
Classification 

1. Objectives: Targeted Goals 

a. # Expected completion 

b- % Passing tests 

c- % Expected employment 

2. Outputs: Actual Attainments 

a. # Actual completions 

b. % Passed 

c. % Actual employed 

3. Costs: Budgeted/ and Expended 

a. $ Total annual expenditure 
b- $ Total annual budget 



Instructional Programs 



50 

90% 

80% 



45 

85% 

70% 



$ 55,000 
$ 50,000 



40 

80% 

70% 



35 

75% 

60% 



$ 35,000 
$ 35,000 



45 

75% 

60% 



40 

60% 

50% 



$ 38,000 
$ 40,000 



Based on these hypothetical data, cost-effectiveness measures were 
computed, using the formulas one through ten developed in Cnapter III 
(pp. 59-61). The computing procedures were as follows (See Table V). 

1. Progrsun effectiveness scores were computed by dividing out- 
puts by target goals using Formula one. Then each score 
was weighted according to its importance: 15 points for 
employment, 10 points for test-pass, and 5 points for 
coitpletion. 

2. Composite and average program' effectiveness indices were 
made by adding the effectiveness scores following Formula 

. two and three. Based on the weighted effectiveness scores, 
' weighted conposite and weighted average effectiveness 
indices were made using formulas four and five. 

3. Cost efficiency was measured by unit costs. Actual and 
budgeted unit costs per completion were computed by 
Formula six and seven. 
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TABLE V 



COMPUTATION OF COST-EFFECTIVENESS MEASURES, 
USING HYPOTHETICAL DATA 



C/E Measiares 

1. Program Effectiveness Scores 

a. % Completion 

b. % Test-pass 

c. % Employment 

(Weighted Effectiveness Scores) 

d. % Completion X 5 

e. % Test-pass X 10 

f . % Employment X 15 

2. Program Effectiveness Index 

a. Composite index: (la + lb + Ic) 

b. Average index: (2a) /3 

c. Weighted composite index: 

(Id + le + If) 

d. Weighted average index: (2c)/30 

3. Cost Efficiency: Unit costs 

a. Actual unit cost per completion 

b. Budgeted unit cost per 

coit^letion 

4. Cost Efficiency Index 

a. Actual unit cost/budget unit 

cost , or 

b. Actual total cost/total 

budgeted cost 

5. C/E ratio and performance ratio 

a. C/E ratio: (2d) /(3a) 

b. Performance ratio: (2d) /(4a) 



Instructional Programs 
ABC 



90.0% 
94.4% 
87.5% 



450.0 
944.0 
1312.5 



271.9 
90.6 

2706.5 
90.2 



1.1 
1.1 



.074 
82.0 



87.5% 
93.8% 
85.7% 



267.0 
938.0 
1285.5 



267.0 
89.0 

2661.0 
88.0 



1 
1 

.088 
88.0 



68.9% 
80.0% 
83.3% 



252.2 
800.0 
1249.5 



252.2 
84.1 

2493.9 
83.1 



$ 1,222 $ 1,000 $ 950 
$ 1,111: $ 1,000 _$ 1,000 



.95 
.95 



.087 
87.4 
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4. A cost efficiency index was made by dividing actual unit 
or total cost by budgeted unit or total cost, using 
Formula eight. 

5. Finally, according to Formula nine a cost-effectiveness 
ratio was computed by dividing the weighted average 
effectiveness index (2-d) by the actual iinir cost (3-a) . 
Then a performance ratio was derived frovi the division 
of the weighted average effectiveness^ inaex (2-d) over 
cost efficiency index (4) , using Formula ten- 
Cos t-effectiveness measures for each instructior • • program resulted 

and appear in Table V. The program effectiveness index, vj^ fficiency 
index, and cost-effectiveness rat: ^ •^>' performance ratio p. ^v?. : a basis 
for answering three questions ^ respectiv-^ly : (1) Which, progi-ant 
was relatively most effective?, (2) WJiich program was relai. '.vci^ most 
efficient?, and (3) Which program perfo.rr.eJ iii the most effective ond 
efficient manner? 

Referring to the program effectiveness index. Program A was indi- 
cated as the most effective among the three programs; whereas Program C 
was considered the most efficient on the basis of the cost efficiency 
index. Furthermore, according to the performance ratio. Program B was 
judged the most effective aiid efficient among tlie three progranis. Thus, 
these cost-effectiveness measuzef^ can be utilized as criteria in evalu- 
ating or comparitvf/ che degree of effectiveness, efficiency, and performance 
of vocational instructional programs. 

CONCLUSIONS AND RECOMMENDATIONS 

This report attempted to conc-^r cuaX ize the natur-:-' of cost-':-f f ec- 
tiveness analysis and to develop & cost-effectiveness ar*alysis model jlor 
secondary vocational programs that included data collection instruments # 
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analytical forms, and standard procedures for using the cost-effectiveness 
analysis system. Throughout the advisory committee meetings and field 
site visitations, the products from the project wer^ evaluated to increase 
their utilization by secondary vocational administrators and educators. 

Conclusions 

With regard to the products from the project, the following con- 
clusions are drawn: 

1- The ccjst-effectiveness analysis concept encompasses a 
varie'ty of features, but it can be defined as an analy- 
tical tool for assessing outcomes of operating and/or 
alternative programs in achieving specified objectives 
in relation to costs. This cI^finition distinguishes the 
cost-effectiveness concept from the cost-iDenef it concept, 
and provides a conceptual model for generating quantified 
cost-effectiveness measures. 

2. The development of the cost-effectiveness analysis model 
for secondary vocational programs identif L^^iid four major 
components. The proper manipulation of the exponents 
results in three important measures providing answers 

to significant management questions. 

3. As a comprehensive framework, the p rposec -nodel is 
expected to be used as a further step in cost-effectiveness 
studies. The relating of program objectives and specifi- 
cations and the cost analysis scheme generating the 

three measures extends the cost-ef f ectivei-!^3s coi^'^^pt 
to practical management information for Cci ;isior; makers. 

4. Using the data types and instruments .developed in the 
study, empirical data analyses can be made to determine 
quantified cost-effectiveness measures as criter a for 
evaluating vocational programs. 

5. As a standard procedure for using the cost-effectiveness 
analysis model, seven steps were conceptualized within 
three phases — planning, implementing, and utilization. 
The procedural scheme can be applied to guide locally 
directed cost-effectiveness studies, which will b*3 
conducted' by vocational administrators. Step-by-step 
activities were developed in Administrator's Manuals 
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Recommendations 

Although this report was concerned with the cost-effectiveness 
analysis of secondary vocational programs, its use may be extended. And 
also the products from the project will be improved by cumulated research 
efforts. From this point of view, the following recommendations including 
suggestions for further studies are made: 

1. Even though the cost-effectiveness model has focused upon 
secondary vocational programs^ the concepts may be 
applied to post-s econ dary vocational program evaluation 
and planning- Furthermore, the basic conceptual scheme 
and technical procedures developed in the model can be 
extended to the evaluation of any kinds of on-going 
and/or alternative prograjfis with appropriate program 
objective specifications. 

2. In determining program objectives and target goals, 
student and community characteristics information should 
be fully considered. The three cost-effectiveness . 
measures derived from the model should not be used as 
exclusive criteria in the decision-making process 
without considerations of student and community charac- 
teristics. Concerned people should be involved in 
determining appropriate program target goals as well 

as interpreting the results. 

3. Cost-effectiveness analyses should be continued as a 
recycling process- Repeated analyses based on accumulated 
data will increase the utility of the analysis. 

4. To facilitate the implementation of cost-effectiveness 
analysis model and data forms as a program management 
system, further efforts should be given to both pilot studies 
for demonstration and to statewide dissemination conferences 
in which local vocational administrators and other concerned 
people may participate. The Project Advisory Committee 
strongly recommended that pilot implementation studies be 
conducted at selected school corporations, and that state- 
wide dissemination conferences be held, with the support 

of state and local education agencies - 

5. Additional research will be needed for determining voca- 
tional program objectives and standardizing cost analysis. 
Based upon further research efforts, the model and products 
will be improved for general use. 
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A Program Classification of Vocational 
Program Areas, Sub-program Areas and/or Courses 



OE Code Program 

01 . 0000 Agriculture 

01.0100 Agricultural Production 

01.0200 Agricultural Supplies/Services 

01.0300 Agricultural Mechanics 

01.0400 Agricultural Products 

01.0500 Ornamental Horticulture 

01.0600 Agricultural Resources 

01.0700 Forestry 

01.9900 Other 



Available (V) 
at the Secondary Level 



04 . 0000 Distribution 

04.0100 Advertising Services 

04.0200 Apparel and .Accessories 

04.0300 Automotive 

04.0400 Finance and Credit 

04.0500 Floristry 

04.0600 Food Distribution 

04.0700 Food Services 

04.0800 General Merchandise 

04.0900 Hardware/ Building Materials 

04.1000 Home Furnishings 

04.1100 Hotel and Lodging 

04.1200 Industrial Marketing 

04.1300 Insurance 

04.1400 International Trade 

04.1500 Personal Services 

04.1600 Petroleum 

04.1700 Real Estate 

"04.1800 Recrerition and Tourism 

04 . 1900 Transportation 

04.9900 Other 



07.0000 Health 

'"7.0101 Dental Assistant 

07.0102 Dental Hygienist (associate degree) 

07.0103 Dental Laboratory' Technology 
07.0203 Medical Laboratory Assisting 
07.0299 Other Medical Laboratory Technology 

07.0301 Nursing (associate degree) 

07.0302 Practical (vocational) Nursing 

07.0303 Nursing Assistant (aide) 

07.0401 Occupational Therapy 

07.0402 Physical Therapy 
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APPENDIX A (continued) 



OE Code Program 

07.0501 Radiolcc,^i':: Technology 

07.0700 Envirorii^vatal Health 

07.0800 Mental Health Technology 

07.0903 Inhalation Therapy 

07.0904 Medical Assistant 
07.0906 Health Aide 
07.9900 Other 



Available (>/) 
at the Secondary Level 



09.0200 Occupational Preparation, Home 
Economics 

09.0201 Care and Guidance of Children 

09.0202 Clothing MGMT. , Production and Services 

09.0203 Food Management, Production and 
Services 

09.0204 Home Furnishing, Equipment and Services 

09.0205 Institutional & Home Management & 
Services 

09.0299 Other 



14.0000 Office 

14.0100 Accounting and Confuting Occupations 

14.0200 Business Data Processing Syst'>:irfls 

Occi^^ations 

14.0300 Filing, Office Machines, Clerical 

Occupations 

14.0400 :information Communication Occupations 

14.0500 Materials Support, Transportation, Etc, 

14.0600 Personnel Training and Related Occu- 

pations 

14.0700 Steno, Secretarial and Related 

Occupations 

14.0800 Supervisory and Admin. Management 

Occupations 
14.0900 Typing and Related Occupations 

14.9900 Other 



16,0000 Technical 

16.0101 Aeronautical Technology 

16.0103 Architectural Technology 

16.0104 Automotive Technology 

16.0106 Civil Technology 

16.0107 Electrical Technology 

16.0108 Electronic Technology 

16.0110 Environmental Control Technology 

16.0111 Industrial Technology 
16.0113 Mechanical Technology 
16.0601 Commercial Pilot Training 

16.9901 Air Pollution Technology 

16.9902 W and Waste Water Technology 
16.9900 Other 
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APPENDIX A (continued) 



OE Code 



Program 



Available 
at the Secondary Leve] 



17.0000 Trades and Industry 

17. 0100 Air. Conditioning 

17.0200 Appliance Repair 

17.0301 nody and Fender Repair 

17.0302 Auto Mechanics 

17.0399 Other Automotive 

17.0400 Aviation Occupations 
17.0500 ' Blueprint Reading 

17.0600 Business Machine Maintenance 

17.0700 Commercial Art Occupations 

17.1001 Carpentry 

17.1002 Electricity 
17.1004 Masonry 

17.1007 Plumbing and Pipefitting 

17.1099 Other Construction and Maintenance 
17.0900 Commercial Photography Occupations 

17.1100 Custodial Service 
17.1200 Diesel Mechanic 
17.1300 Drafting Occupations 
17.1400 Electrical Occupations 
17.1500 Electronic Occupations 
17.1600 Fabric Maintenance Services 
17.1700 Foremanship, Supervision and Mgt. 

Development 

17.1900 Graphic Arts Occupations 

17.2200 Maritime Occupations 

17.2300 Metalworking Occupations 

17.2400 Metallurgy Occupations 

17.2601 Barbering 

17. 2602 Cosmetology 
17.2700 Plastics Occupations 

17.2801 Fireman Training 

17.2802 Law Enforcement Training 
17.2900 Quantity Food Occupations 
17. 3000 Refrigeration 

17.3100 Small Engine Repair 

17.3300 Textile Production and Fabrication 

17.3400 Leather Working 

17.3500 Upholstering 

17.3600 Woodworking Occupations 

17.9900 Other 
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APPENDIX B 



PROG RAM OBJECTI V, E S AND TARGET GOALS 



OBJECTIVE 1 . Aid Students enrolled in vocational education to successfully 
complete a secondary occupational program . 



1-a. percent of the student population will be enrolled in the 

secondary vocational program during the 19 - 19 school 

year- 

1-b. percent of the students will complete the program re- 
quirements - 

1-c. percent of the student completions will have on the job 

occupational experience. -\ 

1-d, percent less dropout rate will occur in the vocational 

program than the total dropout rate for the entire school - 

1-e. percent of the student con^letions will rate their pro- 
gram as satisfactorily meeting their educational goals - 

1-f . percent of the student completions will indicate they 

would recommend their vocational program to other students. 



OBJECTIVE 2 - Assist special student groups to successfully achieve in a 
secondary vocational prograia . 

2-a. percent of the persons identified as special education 

students will he enrolled in the vocational program (mainstream) . 

2-b. percent of the disadvantaged students will be enrolled 

in the vocational program. 

2-c. disadvantaged persons (economically and/or educationally) 

will conplete the secondary vocational program. 

2-d. disadvantaged students (economically and/or educationally) 

will participate in work-study programs 

2-e. handicapped persons (physical and/or mental) will success- 
fully conrplete the secondary vocational program. 

2-f. exceptional youth will complete the secondary vocational 

program. 

2-g. percent of the students enrolled will represent the sex 

minority in those programs -.raditionally considered sex-stereotyped. 
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percent of the students classified in special student 

groups who can benefit from a related or enabling skills 
course will be enrolled in such courses, 

percent of the students enrolled in related or enabling 

skills courses will attain minimum competencies in order to 
benefit from vocational or preparatory programs. 

percent of the students classifii^.d in special student 

groups will rate their vocational progr-am as satisfactorily 
meeting their educational goals. 

percent of the special student group completions will 

indicate they would recommend their vocational program to 
other students. 



Provide vocational education for secondary school youth in 
accordance with their occupational preparation . 

percent of the students available for and having sought 

employment will be enployed full-time in less than fifteen 
weeks after graduation. (Consider militazy and apprenticeships 
as employed.) 

percent of: the graduates available for and having sought 

eit5>loyment in their specialization will be enployed in their 
specialization in less than fifteen weeks after graduation. 
(Include military and apprenticeships if in the area of spec- 
ialization - ) 

percent of the graduates available for employment will 

be eit5>loyed in their specialization or in a position they con- 
sidered related to their area in less than fifteen weeks after 
graduation. (Include military and apprenticeships if in spec- 
ialization or related area* ) 

percent of the enrollees who terminate schooling before 

coir^leting program requirements will find their first full-time 
job in the occupation for which they were being trained or a 
related area. (Include military and apprenticeships if in 
specialization or related area.) 

percent of the graduates of any licensed occupation pro- 
gram (who apply and take) will pass the appropriate examination 

percent of the students responding on a follow-up study 

will indicate they are satisfied with their job- 

percent of the students employed six (6) months after 

graduation will indicate that their skill preparation was ade- 
quate for their present job. 
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3-h. percent of the graduates will indicate they were adequately 

prepared, to work with supervisors, co-workers ,a^d subordinates . 



OBJECTIVE 4 . Provide leadership development activities for students enrolled 
' ^ in vocational programs through a youth organizavion functioning 
as an integral part of the vocational instruction . 

percent of the students enrolled in the vocational pro- 
gram will have taken an active part in (youth organization, 
i.e., VICA, FFA, FHA, etc.) activities for the school year. 

4-b. percent of youth organization participants will rate the 

activities as meeting their needs and interests. 



OBJECTIVE 5 . Provide guidance and counseling services (career development)- 
information appropriate to continued education or employment 
for students enrolled in vocational programs . 

5-a. vocational students will receive career counseling and 

guidance services. 

5-b. students will receive career development information 

during the school year 19 - 19 . 

5-c. percent of the students will indicate career guidance 

and counseling services as adequate after completion of their 
vocationalv program. 

5-d. percent of the students receiving exploratory career 

information will rate the eJ^erience as having influence on 
their career choice. 



' OBJECTIVE 6 . Provide vocational programs to fulfill the requirement <^f 

the labor markets and the employment community manpower needs . 

6-a. percent of the student conpletions will be working in the 

enployment community serviced by the school corporation. 

6-b. percent of the student completions will seek, employment 

external to the employment community in which they'd/ere trained. 

6-c. percent of all students will be enrolled in the vocational 

program that is considered to have high employment community and 
manpower occupational needs. (Projected) 
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6-d, employers will value the vocati'^nal program as a source 

of trained manpower. 

6-e. employers will indicate that the employees* vocational 

preparation was critical in the employment decision. 

6-f. employers vrill rank the employees' skill and knowledge 

level at a minim™ of fairly skilled or above. 

6-g. employers will indicate job advancement is related to 

training received in the vocational education programs. 

6-h. employers will rate the employees on the job maturity 

factors at a minimum mean of good or above. 



OBJECTIVE 7 . Encourage vocational graduates to continue their education after 
cCiTipletion of their secondary program , 

7-.a. percent of the students who complete the vocational program 

will be enrolled in advanced study programs. 

7-b. percent of the students enrolled in advanced study pro- 
grams will be in the same program specialty as their secondary 
vocational program. 

7-c. percent of the students enrolled in advanced study 

programs will be in their specialization or programs which 
they considered related to their secondary vocational program. 

7-d. percent of the students enrolled in advanced study pro- 

grams will rate their secondary vocaticnal program as instru- 
mental in their decision to continue their education. 

7-e. percent of the students enrolled in advanced study pro- 
grams will indicate their vocational program prepared them for 
their pursuit of advanced study. 
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Secondary Vbcationa! Instructional Program Data 



C/E FORM IL6. STUDENT PARTICIPATION IN YOUTH ORGANIZATIONS 



( 1 ) 


(2) 


(3) 


1 nstruct lona I Programs 

1 . 


Yr'jth Organization 


i^umber o^ Participants 


2. 






3. ,. 






4. 






5. 






6. 






7. 






8, 






9. 






10. 






11. 






12. 






13. 






14. 






15. 






16. 






17. 






13. 






19. 






20. 






TOTAL 
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APPENDIX C (continued) 

"""■"^^^"^"■^ Code No. 

C/E FORM III 

StudentsV Follow-up Program Rating Scale 



This questionnaire is one portion of an evaluation of vocational education programs. Information you can provide 
will serve as an importemt basis for decisions regarding local school programs. 

The information on this form will be used as a program class profile. Please note that your name does not appear 
on the questionnaire. This confidential data will not be reported as information on specific students » employers, or 
teachers. The code number at the top of the page will be used to record .person returning the questionnaire. 



INSTRUCTIONS: Please mark reponses to the following questions or statements. When you have completed the 
questionnaire, return it in the enclosed postage paid envelope. 



THANK YOU FOR YOUR TIME AND THOUGHTS. 



Were you enrolled in a vocational education 
program while in school? 



Yes 



No 



□ 



What type of vocational program: 

Agriculture □ 

Dirtrlbutive Education □ 

Business □ 

Health □ 

Home Economics □ 

Trade & Industry □ 



3. Has your address changed since leaving school? 
Yes . . . . □ No ... □ 

3a. If you answered "yes" above, where did you move? 

To a place in the ssme county □ 

To a different county (same state) 

To a different state 



4. Since you left school, did you seek full-time 
employment? (35 or more hours per week) 



Yes 



No 



Answer these questions if ypu are working full-time . 

7. How long after leaving high school did you begin 
your first full-time job? 

No waiting period . , □ 

Less than 4 weeks □ 

4 to 8 weeks □ 

8 to 12 weeks □ 

12 to 15 weeks □ 

15 to 18 weeks □ 

18 to 24 weeks □ 

8. Is your present job related to the vocational 
training you received? 

Same occupation □ 

Highly related □ 

Slightly related □ 

Totally unrelated □ 



g. Did your first job require that you take a 
licensed examination? 



Yes 



No 



10. Did you pass the examination? 
Yes ... □ 



No 



5. What is your present employment status? 

Employed: full-time (35 or more hours 

per week) □ 

Employed: part-time (less than 35 

hours per week) □ 

Not Employed: looking for work □ 

Not Employed: not looking for work □ 

Attending school □ 

Married or getting married □ 

Military □ 

Other (explain) 

6. Have you had a full-time job since leaving 
high school? 

Yes , . . □ No ... □ 



If you are going to schools answer these questions . 
11. Are you enrolled in advanced study? 

Yes ... □ No ... □ 



12. What is the relationship of your advanced study 
program to your high school vocational progran.'? 

New program Is in the same occupation . . .□ 

New program is in a related occupation . .□ 

New program is in an entirely different 

occupation □ 
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APPENDIX C (continued) 



Bate the following items as they state your personal feelings or experiences. Chbck the blank according to whether 
you agree or disagree with the statement. 



13. I'm satisfied with the vocational training I received In high school as 
meeting wy goals. 



14. I would recommend this vocational program to others. 



15, The vocational youth organization activities met my needs and interests. 



Agree 



□ 
□ 
□ 



Don't 

Know Disagree 



□ 
□ 
□ 



□ 
□ 
□ 



16. I feel that the career counseling and guidance services I received at 
school were adequate. 



17. The career information that I received during the school was influential 
In my career choice. 



□ 



□ 



□ 



Rate if working . 

18. I was adequately prepared for my present job by n\y vocational program. 



19. I was adequately trained to get along with others at work by my 
vocational prooram. 



20. I am satisfied with my present job. 



□ 
□ 



□ 
□ 



□ 
□ 



Rate if going to school . 

21. The vocational program that I completed was influential in rny decision 
to Cake advanced studies. 



22, The vocational program that I completed prepared me to pursue advanced 
study. 



□ 
□ 



□ 
□ 



□ 
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(13) 

Quest ion 
#tl . # of 

Yes boxes 
Checked 






(12) 

Quest Ion 
#10. # of 
Yes Boxes 
Checked 






(h; 

Question 
#9. # of 
Yes boxes 
Checked 






(10) 
Question 
#8. # of 
Boxes 
Checked 
Highly or 
SI Ightly 
Related 






(9) 

Quest Ion 
#8. # 
Checked 
Same 
Occupat Ion 






(8) 

Question 
#7. Total 
Boxes 
Checked 
15 Wks. 
or more 






(7) 

Question 
#7. Total 

Checked 
15 Wks. 
or Less 






ui 

0 0 X o 
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\£) in Q 
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(5) 

(?uest*on 

15. ■ 
Attend 1 ng 

School 






(4) 

Question 

Employed 
runtime 






(3) 

Question 
14. 9 of 

Yes Boxes 
Chocked 






(2) 

(^est Ion 
#3a. § 
Moved 
Out of 
County 

or State 






(1) 

Question 
#3. a of 
No Boxes 
Checked 


Tai ly 


Total 



(25) 
Question 
#22. # of 
Agreed 
Boxes 
Chec ked 




■ 'K- 


(24) 
Question 
#21. # of 
Agreed 
Boxes 
Checked 






(23) 
Question 
#20. # of 
Agreed 
Boxes 
Checked 






(22) 
Question 
#19. # of 
Agreed 
Boxes 
Checked 






(21 ) 
Question 
#18. # of 
Agreed 
Boxes 
Checked 






(20) 
Question 
#17. # of 
Agreed 
Boxes 
Checked 
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w 0) ^ < CD ^ 
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(17) 
Question 
#14. # of 
Agreed 
Boxes. 
Checked 






(16) 
Question 
#13. # of 

Agreed 
Boxes 
Checked 






(15) 
Question 
#12. # of 
Boxes 
Chec ked 
Related 
Occupation 






(14) 

Question 
#12. # in 

' Same 
Occupation 


Tal ly 


Total 
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C/B FORM IV code No. 

Employers' Opinion on Vocational Training of Employees 



Dear Employer.: 

This questionnaire was developed for you to provide information on the vocational training of an employee in your 
firm. Your' response will serve as a basis for -decisions regarding local vocational program development and operation. 
This confidential data will not be reported as information on specific students/ employers, or teachers. 

Please provide the appropriate information about the designated employee. When you have completed the question- 
naire, return- it in the enclosed pcstage paid envelope. 



is an employee in your firm. 



1. What is the title of the position he/she holds within the firm? (example: secretary, machine operator, cashier, 
etc.) 



Job title: 



2. When hiring the person, did you consider his/her vocational training at the high school level as critical in your 
decision? 



Yes 



. . . . □ No □ Undecided □ 

3. Please rate the person's occupational skills at the time the person was employed. 

No skin and knowledge □ 

Limited skill and knowledge H 

Fair skill and knowledge [j 

Exceptional skill and knowledge p 

4. Do you think that the employee's skill or knowledge attained through the vocational training program has allowed 
the employee to advance in his/her job? 



Yes 



No 



Undecided 



5. Do you look to the vocational education program as a good source of trained personnel? 

Yes □ No . . . . ^. . □ Undecided □ 

6. Please rate the employee in the following factors: (check each of the items on the adjacent scale) 

Factors 



A) Cooperati veness with supervisor 

B) Cooperati veness with other employees 

C) Interest in the job 

D) Attendance and punctuality 

E) Productivity 



Poor 

I 


Fair 


Good 


Very Good 


Excellent 
1 


Poor 
1 


Fair 


Good 


Very Good 


Excel 1 ent 


Poor 

1 


Fair 


Good 


Very Good 


Excellent 


Poor 
1 


Fair 


Good 


Very Good 


Excellent 
1 


Poor 


Fair 


Good 


Very Good 


Excel lent 
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APPENDIX C (continued) 



Vocational Instructional Program Cost Data 



Q Budgeted 

C/E FORM V-1. 

SALARIES FOR INSTRUCTIONAL PROGRAM STAFF AND PTE DATA' ^ Actual 



(1) 

1 nstructlona 1 Program 


(2) 

1 nstructlona 1 
Sa 1 3 r y 




(3) 
pTE 




(4) 

Average 
1 iibTrucT 1 ona 1 
Sa lary 


1 . 












2. 












3. 












4. 












5. 










^ •,•*■'.' .'• • 


6. 












' 7. 










' 


8. 












9. 












\0. 
























\ I. 












12. 












13. 










♦* • 


14. 








4 




15. 












16. 












17. 












16. 












19. 












20. 










TOTAL 













*Relmburseab 1 e salary for all vocational Instructional staff. 
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APPENDIX C (continued) 



Vocational Instructional Program Cost Data 



O Budgeted 

C/E FORM V-3. TRAVEL COST ASSIGNED TO PROGRAMS □ Actual 



(1 ) 

1 nstruct i ona 1 Programs 


(2) 

1 nstruct \ ona 1 
Personnel ■ 


(3) 

Instructional . 
Act 1 vi 1 1 es 


(4) 
Total 
Cost 


1 . 








2. 








3. 








4. 








5. 




1 




6. 








7. 








8. 








9. 








10. 








1 1 . 








12. 








13. 








14. 








15. 








16. 








17. 








18. 








19. • ■' ; 








20. 








TOTAL 









APPENDIX C (continut-?d) 



115 



Vocational Instructional Program Cost Data 



□ Budgeted 

C/E FORM V-4. COST OF INSTRUCTIONAL SUPPLIES AND MATERIALS ^ Actual 



t 1 ) 

1 nstroctlona 1 Programs 


Consomab i 8 
Sopp 1 les 


Text Books 

and 
Reforences 


'Jtner 
SoppI ies 


\ J ) 

Tota I 
Cost 


1 . 










2. 










3. 










4. 










5. 










6. 










7. 










S. 










9. 










10. 










1 1 . 










1 o 










13. 










14, 










15. 










16. 










17. 










13. 










19. 










20. 










TOTAL 
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Vocational Instructional Program Cost Data 

□ Bodgeted 

□ Actual 



C/E FORM V-10. OTHER DIRECT COST 



( 1 \ 

Instructional Programs 


(2) 
Costs 


1 . 








3. 




4 . 








6 . 




7 . 




8 . 




9 . 




1 0 . 
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TOTAL 
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Vocational Instructionai Program Cost Data 



□ Budgeted 

C/E FORM V.12, PRORATED SUPPORTING Q f^^^^^^ 
SERVICES COST PER INSTRUCTIONAL PROGRAM 



(I ) 

Instructional Programs 


(2) «r 

Total Proration Cost Per 
instructional Program'* 
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15. 




16. 




17. 




18, 




19. 




20. 




TOTAL 




*Oata can be obtained from Individual program sheets Form V-ll, 
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